neopolita / Qwen3.8-Flash-Next-99B-A5B-Niwaki-3bit-mlx
Text Generation73B1.5K7Updated Sep 20, 2026
Downloads
1.5K
Likes
7
Last updated
Sep 20, 2026
License
other
Qwen3.8-Flash-Next pruned to 99B total / ~5.2B active parameters, stored at 3-bit — 4.1× less expert memory than the 4-bit reference, 36.7 GB on disk: half the bytes of the smallest published quant, and it fits a 48 GB Mac. Stock mlx-vlm plus the small loader shipped in this r…
Tasks & library
- text generation
- mlx
Tags
- mlx
- qwen4_exp
- moe
- pruning
- quantization
- mixture-of-experts
Technical specifications
Parameters73B
Librarymlx
LanguagesNot available
Base modelmlx-community/Qwen3.8-Flash-Next-4bit
Licenseother
