neopolita / Qwen3.8-Flash-Next-99B-A5B-Niwaki-3bit-gguf
Text Generation1.8K4Updated Oct 14, 2026
Downloads
1.8K
Likes
4
Last updated
Oct 14, 2026
License
other
GGUF builds of Qwen3.8-Flash-Next-99B-A5B-Niwaki-3bit-mlx — Qwen3.8-Flash-Next pruned to 99B total / ~5.2B active parameters — for llama.cpp on CUDA, Vulkan, Metal and CPU. Requires the neopolita-llama.cpp fork (see Usage): stock llama.cpp cannot represent this model's layout …
Tasks & library
- text generation
- gguf
Tags
- gguf
- llama.cpp
- moe
- pruning
- quantization
- mixture-of-experts
Technical specifications
ParametersNot available
Librarygguf
LanguagesNot available
Licenseother