hugpadhugpad

trillionlabs / Gravity-16B-A3B-Preview

Text Generation16B30917Updated Apr 15, 2026
Hugging Face

Downloads

309

Likes

17

Last updated

Apr 15, 2026

License

apache-2.0

Gravity-16B-A3B-Preview is a post-trained language model built on Gravity-16B-A3B-Base by Trillion Labs. Starting from the base model, it underwent context length extension (32K → 128K), supervised fine-tuning (SFT), and reinforcement learning (GRPO) focused on science and code.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gravity_moe
  • text-generation
  • moe
  • mixture-of-experts
  • gravity

Technical specifications

Parameters16B
Librarytransformers
Languagesen, ko
Base modeltrillionlabs/Gravity-16B-A3B-Base
Licenseapache-2.0