arcee-ai / Trinity-Large-TrueBase

Text Generation399B1.1K69Updated May 28, 2026

Downloads

1.1K

Likes

69

Last updated

May 28, 2026

License

openmdw-1.1

Trinity-Large-TrueBase is a base pretraining checkpoint from Arcee AI's Trinity Large training run. It is a 398B-parameter sparse Mixture-of-Experts (MoE) model with approximately 13B active parameters per token. The checkpoint was captured after 10 trillion tokens of pretrain…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • afmoe
  • text-generation
  • conversational
  • custom_code
  • en

Technical specifications

Parameters399B
Librarytransformers
Languages11 languages
Licenseopenmdw-1.1