neopolita / Niwaki-Flash-Next-23GB-v4.0-gguf
Text Generation2710Updated Oct 14, 2026
Downloads
271
Likes
0
Last updated
Oct 14, 2026
License
other
GGUF build of Niwaki-Flash-Next-19GB-v4.0-mlx — Qwen3.8-Flash-Next at 119B total / ~5.6B active parameters — for llama.cpp on CUDA, Vulkan, Metal and CPU. One 40.2 GB file whose GPU part is 21.1 GiB: the 15.6 GiB n-gram embedding table stays in CPU memory, read from the file a…
Tasks & library
- text generation
- gguf
Tags
- gguf
- llama.cpp
- moe
- pruning
- quantization
- mixture-of-experts
Technical specifications
ParametersNot available
Librarygguf
LanguagesNot available
Licenseother
