neopolita / Niwaki-Flash-Next-23GB-v4.0-gguf

Text Generation2710Updated Oct 14, 2026

Downloads

271

Likes

0

Last updated

Oct 14, 2026

License

other

GGUF build of Niwaki-Flash-Next-19GB-v4.0-mlx — Qwen3.8-Flash-Next at 119B total / ~5.6B active parameters — for llama.cpp on CUDA, Vulkan, Metal and CPU. One 40.2 GB file whose GPU part is 21.1 GiB: the 15.6 GiB n-gram embedding table stays in CPU memory, read from the file a…

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • llama.cpp
  • moe
  • pruning
  • quantization
  • mixture-of-experts

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Licenseother