moonshotai / Moonlight-16B-A3B-Instruct
Text Generation16B37.4K209Updated Jan 30, 2026
Downloads
37.4K
Likes
209
Last updated
Jan 30, 2026
License
mit
- Weight Decay: Critical for scaling to larger models - Consistent RMS Updates: Enforcing a consistent root mean square on model updates
Tasks & library
- text generation
- transformers
Tags
- transformers
- deepseek_v3
- text-generation
- conversational
- custom_code
Technical specifications
Parameters16B
Librarytransformers
LanguagesNot available
Licensemit