ISTA-DASLab / Qwen3-8B-GGUF-GSQ
Text Generation5754Updated May 18, 2026
Downloads
575
Likes
4
Last updated
May 18, 2026
License
apache-2.0
GGUF K-Quant checkpoints of Qwen/Qwen3-8B in which the discrete grid assignments have been refined with GSQ (Gumbel-Softmax Quantization), starting from the public Unsloth GGUF initialization and projected back into the same K-Quant format. The optimized files run unchanged on…
Tasks & library
- text generation
- gguf
Tags
- gguf
- gsq
- gumbel-softmax
- quantization
- ptq
- qwen3
