axolotl-ai-co / Qwen3.8-27B-GGUF

Other2.4K0Updated Oct 30, 2026

Downloads

2.4K

Likes

0

Last updated

Oct 30, 2026

License

apache-2.0

XQD quantizations of Qwen/Qwen3.8-27B at 2, 3 and 4 bits. Each quant comes in two versions: one with the model's multi-token-prediction (MTP) block, and one without it (-nomtp) for runtimes that don't use it. The 4-bit quant is also at axolotl-ai-co/Qwen3.8-27B-Q4-GGUF, and th…

Tasks & library

  • gguf

Tags

  • gguf
  • llama.cpp
  • quantized
  • imatrix
  • conversational

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Licenseapache-2.0