moonshotai / Moonlight-16B-A3B
Text Generation16B19.7K118Updated Jan 30, 2026
Downloads
19.7K
Likes
118
Last updated
Jan 30, 2026
License
mit
- Weight Decay: Critical for scaling to larger models - Consistent RMS Updates: Enforcing a consistent root mean square on model updates
Tasks & library
- text generation
- transformers
Tags
- transformers
- deepseek_v3
- text-generation
- conversational
- custom_code
Technical specifications
Parameters16B
Librarytransformers
LanguagesNot available
Licensemit