ISTA-DASLab / Qwen3-4B-GGUF-GSQ
Text Generation2341Updated May 18, 2026
Downloads
234
Likes
1
Last updated
May 18, 2026
License
apache-2.0
GGUF K-Quant checkpoints of Qwen/Qwen3-4B in which the discrete grid assignments have been refined with GSQ (Gumbel-Softmax Quantization), starting from a public GGUF initialization and projected back into the same K-Quant format. The optimized files run unchanged on llama.cpp…
Tasks & library
- text generation
- gguf
Tags
- gguf
- gsq
- gumbel-softmax
- quantization
- ptq
- qwen3
