IFM / K2-Horizon-375B-A23B
Text Generation379B15.4K116Updated Oct 14, 2026
Downloads
15.4K
Likes
116
Last updated
Oct 14, 2026
License
apache-2.0
K2-Horizon-375B-A23B is the flagship of the K2-Horizon family: a sparse Mixture-of-Experts model that stores 375B parameters and runs 23B per token, with a 512K context window. We have released the checkpoints, along with the data and the training code.
Tasks & library
- text generation
- transformers
Tags
- transformers
- k2_horizon
- text-generation
- k2-horizon
- 375b
- moe
Technical specifications
Parameters379B
Librarytransformers
Languagesen
Licenseapache-2.0