axolotl-ai-co / Qwen3.8-27B-GGUF
Other2.4K0Updated Oct 30, 2026
Downloads
2.4K
Likes
0
Last updated
Oct 30, 2026
License
apache-2.0
XQD quantizations of Qwen/Qwen3.8-27B at 2, 3 and 4 bits. Each quant comes in two versions: one with the model's multi-token-prediction (MTP) block, and one without it (-nomtp) for runtimes that don't use it. The 4-bit quant is also at axolotl-ai-co/Qwen3.8-27B-Q4-GGUF, and th…
Tasks & library
- gguf
Tags
- gguf
- llama.cpp
- quantized
- imatrix
- conversational
