neopolita / Qwen3.8-Flash-Next-99B-A5B-Niwaki-3bit-mlx

Text Generation73B1.5K7Updated Sep 20, 2026

Downloads

1.5K

Likes

7

Last updated

Sep 20, 2026

License

other

Qwen3.8-Flash-Next pruned to 99B total / ~5.2B active parameters, stored at 3-bit — 4.1× less expert memory than the 4-bit reference, 36.7 GB on disk: half the bytes of the smallest published quant, and it fits a 48 GB Mac. Stock mlx-vlm plus the small loader shipped in this r…

Tasks & library

  • text generation
  • mlx

Tags

  • mlx
  • qwen4_exp
  • moe
  • pruning
  • quantization
  • mixture-of-experts

Technical specifications

Parameters73B
Librarymlx
LanguagesNot available
Licenseother