kaitchup / Qwen3.8-27B-SLQ-EAR98.5
Text Generation8B3466Updated Oct 26, 2026
Downloads
346
Likes
6
Last updated
Oct 26, 2026
License
apache-2.0
This is Qwen/Qwen3.8-27B, compressed with a customized version of SLQ (Statistically-Lossless Quantization) and packed for Humming in vLLM. The search combines several quantization sources and chooses precision separately for individual projections, including selected attentio…
Tasks & library
- text generation
Tags
- qwen3_5
- slq
- mixed-precision
- humming
- vllm
- gptq
