hugpadhugpad

Infinigence / Megrez2-3x7B-A3B-Preview

Text Generation7.5B196Updated Jul 25, 2025
Hugging Face

Downloads

19

Likes

6

Last updated

Jul 25, 2025

License

apache-2.0

Megrez2-3x7B-A3B-Preview is a device native large language model. Megrez2 takes advantages of both the accuracy of Mixture-of-Experts (MoE) architecture and the compact size of Dense models. This preview model was trained on 5T Tokens of data. The official release, with larger…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • megrez_moe
  • text-generation
  • moe
  • conversational
  • custom_code

Technical specifications

Parameters7.5B
Librarytransformers
Languagesen, zh
Licenseapache-2.0