neopolita / Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit-gguf

Text Generation1.1K4Updated Oct 14, 2026

Downloads

1.1K

Likes

4

Last updated

Oct 14, 2026

License

other

GGUF builds of Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit-mlx — Qwen3.8-Flash-Next pruned to 102B total / ~5.3B active parameters, with the variable-tracking behaviours the first-generation 99B lost back at the unpruned model's level — for llama.cpp on CUDA, Vulkan, Metal an…

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • llama.cpp
  • moe
  • pruning
  • quantization
  • mixture-of-experts

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Licenseother