trillionlabs / Gravity-30B-A5B-Preview

Agents30B5313Updated Sep 9, 2026

Downloads

531

Likes

3

Last updated

Sep 9, 2026

License

apache-2.0

Gravity-30B-A5B-Preview is a post-trained language model built on Gravity-30B-A5B-Base by Trillion Labs. Starting from the 128K-context base model, it underwent long-context supervised fine-tuning (SFT) and several rounds of preference optimization (DPO), with the final rounds…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gravity_moe
  • text-generation
  • moe
  • mixture-of-experts
  • gravity

Technical specifications

Parameters30B
Librarytransformers
Languagesen, ko
Licenseapache-2.0