ISTA-DASLab / Qwen3-8B-GGUF-GSQ

Text Generation5754Updated May 18, 2026

Downloads

575

Likes

4

Last updated

May 18, 2026

License

apache-2.0

GGUF K-Quant checkpoints of Qwen/Qwen3-8B in which the discrete grid assignments have been refined with GSQ (Gumbel-Softmax Quantization), starting from the public Unsloth GGUF initialization and projected back into the same K-Quant format. The optimized files run unchanged on…

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • gsq
  • gumbel-softmax
  • quantization
  • ptq
  • qwen3

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Base modelQwen/Qwen3-8B
Licenseapache-2.0