ISTA-DASLab / Kimi-K3-P48NVFP4-MoESQ

Text Generation4164Updated Oct 5, 2026

Downloads

416

Likes

4

Last updated

Oct 5, 2026

License

kimi-k3

A W4A4 + paired-4:8 sparse compressed checkpoint of moonshotai/Kimi-K3, produced with MoESQ. The routed-expert weights are NVFP4 with paired-4:8 structured sparsity, and they are stored sparse: only the kept values plus a small mask are on disk, not a dense NVFP4 tensor with z…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • kimi_k3
  • feature-extraction
  • kimi-k3
  • moe
  • nvfp4

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licensekimi-k3