hugpadhugpad

Infinigence / Megrez2-3x7B-A3B

Text Generation7.5B13118Updated Sep 18, 2025
Hugging Face

Downloads

131

Likes

18

Last updated

Sep 18, 2025

License

apache-2.0

Megrez2-3x7B-A3B is a device native large language model. Megrez2 takes advantages of both the accuracy of Mixture-of-Experts (MoE) architecture and the compact size of Dense models. This release model was trained on 8T Tokens of data. In the future, we plan to improve the mod…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • megrez_moe
  • text-generation
  • moe
  • conversational
  • custom_code

Technical specifications

Parameters7.5B
Librarytransformers
Languagesen, zh
Licenseapache-2.0