Search results

[REQUEST] Please add support for Qwen3VL

Status: Open.

#811 In turboderp-org/exllamav2;

· sujitvasanth opened on Oct 25, 2025

[REQUEST] Make a version that is on Cuda V13

Status: Open.

#810 In turboderp-org/exllamav2;

· thebaconstudio opened on Oct 15, 2025

[QUESTION] Inquiry about DynamicGenerator: EOS not returned until max_new_tokens reached, despite stop_conditions

bugSomething isn't workingSomething isn't working

Status: Open.

#809 In turboderp-org/exllamav2;

· keds-rnd opened on Oct 14, 2025

[BUG] 2080ti outputs gibberish

bugSomething isn't workingSomething isn't working

Status: Open.

#808 In turboderp-org/exllamav2;

· frenzybiscuit opened on Oct 12, 2025

[QUESTION] I cannot achieve token/s speed as in your tests even with better GPU

bugSomething isn't workingSomething isn't working

Status: Open.

#806 In turboderp-org/exllamav2;

· piercarlo62 opened on Sep 22, 2025

[REQUEST]Please support Torch 2.8

Status: Open.

#804 In turboderp-org/exllamav2;

· pivtienduc opened on Aug 16, 2025

[BUG] [Cause Identified & Workarounds Proposed] Infinite Generation for Llama3 & Other Models with Multiple EOS IDs

bugSomething isn't workingSomething isn't working

Status: Open.

#803 In turboderp-org/exllamav2;

· abgulati opened on Jul 29, 2025

[BUG] Unable to run examples/chat.py

bugSomething isn't workingSomething isn't working

Status: Open.

#802 In turboderp-org/exllamav2;

· homeworkace opened on Jul 29, 2025

[REQUEST] Support for Hunyuan-A13B-Instruct

Status: Open.

#798 In turboderp-org/exllamav2;

· RodriMora opened on Jun 27, 2025

[BUG] ExLlamaV2Generator import broken across WHL & source repo — Windows 11 + RTX 5090 + CUDA 12.8 build inconsistencies

bugSomething isn't workingSomething isn't working

Status: Open.

#797 In turboderp-org/exllamav2;

· mindworksmanagement opened on Jun 16, 2025

[BUG] ExllamaV2 version >0.2.8 broken for mistral 7b(v0.2) models on Nvidia 2060

bugSomething isn't workingSomething isn't working

Status: Open.

#795 In turboderp-org/exllamav2;

· IceFog72 opened on Jun 9, 2025

[BUG] Exllamav2 quickly devolves into endless repetition in versions newer than 2.8.0

bugSomething isn't workingSomething isn't working

Status: Open.

#793 In turboderp-org/exllamav2;

· ZhenyaPav opened on May 28, 2025