hugpadhugpad

trillionlabs / Gravity-bio-16B-A3B

Text Generation16B1652Updated Jun 26, 2026
Hugging Face

Downloads

165

Likes

2

Last updated

Jun 26, 2026

License

apache-2.0

Gravity-bio-16B-A3B is a biology-focus midtrained model derived from Gravity-16B-A3B-Base. It uses the same sparse Mixture-of-Experts (MoE) architecture and tokenizer as Gravity-16B-A3B-Base, with additional midtraining for biological understanding on TheBioCollection corpus.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gravity_moe
  • text-generation
  • moe
  • mixture-of-experts
  • gravity

Technical specifications

Parameters16B
Librarytransformers
Languagesen, ko
Base modeltrillionlabs/Gravity-16B-A3B-Base
Licenseapache-2.0