ISTA-DASLab / Qwen3.5-4B-GGUF-GSQ

Text Generation1.5K9Updated May 26, 2026

Downloads

1.5K

Likes

9

Last updated

May 26, 2026

License

apache-2.0

GGUF Q2KXL checkpoint of Qwen/Qwen3.5-4B in which the discrete grid assignments have been refined with GSQ (Gumbel-Softmax Quantization), starting from the public Unsloth GGUF initialization and projected back into the same K-Quant format.

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • gsq
  • gumbel-softmax
  • quantization
  • ptq
  • qwen3.5

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Base modelQwen/Qwen3.5-4B
Licenseapache-2.0