hugpadhugpad

xiaomi-research / MiLMMT-46-1B-Pretrain

Text Generation1.3B385Updated Feb 13, 2026
Hugging Face

Downloads

38

Likes

5

Last updated

Feb 13, 2026

License

gemma

MiLMMT-46-1B-Pretrain is a language model developed through continual pretraining of Gemma3-1B using a mix of 143 billion tokens from both monolingual and parallel data across 46 different languages. Please find more details in our paper: Scaling Model and Data for Multilingua…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gemma3_text
  • text-generation

Technical specifications

Parameters1.3B
Librarytransformers
LanguagesNot available
Base modelgoogle/gemma-3-1b-pt
Licensegemma