neopolita / Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-gguf
Text Generation8754Updated Oct 14, 2026
Downloads
875
Likes
4
Last updated
Oct 14, 2026
License
other
GGUF builds of Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-mlx — Qwen3.8-Flash-Next pruned to 113B total / ~5.4B active parameters (routed experts kept on 32 of the 48 layers) — for llama.cpp on CUDA, Vulkan, Metal and CPU. Requires the neopolita-llama.cpp fork (see Usage): stock …
Tasks & library
- text generation
- gguf
Tags
- gguf
- llama.cpp
- moe
- pruning
- quantization
- mixture-of-experts
Technical specifications
ParametersNot available
Librarygguf
LanguagesNot available
Licenseother