Motif-Technologies / Motif-3-Base

Text Generation315B69537Updated Nov 2, 2026

Downloads

695

Likes

37

Last updated

Nov 2, 2026

License

mit

Motif 3 Base is the base pretrained checkpoint of Motif 3 — a large-scale, decoder-only Mixture-of-Experts (MoE) language model with 314 billion total parameters and 13.2 billion parameters activated per token. It is built from the ground up by Motif Technologies following a f…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • Motif
  • feature-extraction
  • motif
  • motif-3
  • mixture-of-experts

Technical specifications

Parameters315B
Librarytransformers
Languagesen, ko
Licensemit