neopolita / Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit-gguf
Text Generation1.1K4Updated Oct 14, 2026
Downloads
1.1K
Likes
4
Last updated
Oct 14, 2026
License
other
GGUF builds of Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit-mlx — Qwen3.8-Flash-Next pruned to 102B total / ~5.3B active parameters, with the variable-tracking behaviours the first-generation 99B lost back at the unpruned model's level — for llama.cpp on CUDA, Vulkan, Metal an…
Tasks & library
- text generation
- gguf
Tags
- gguf
- llama.cpp
- moe
- pruning
- quantization
- mixture-of-experts
Technical specifications
ParametersNot available
Librarygguf
LanguagesNot available
Licenseother
