hugpadhugpad

allenai / OLMoE-1B-7B-0125

Text Generation6.9B7.9K40Updated Mar 16, 2025
Hugging Face

Downloads

7.9K

Likes

40

Last updated

Mar 16, 2025

License

apache-2.0

OLMoE-1B-7B is a Mixture-of-Experts LLM with 1B active and 7B total parameters released in January 2025 (0125) that is 100% open-source. It is an improved version of OLMoE-09-24, see the paper appendix for details.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • olmoe
  • text-generation
  • moe
  • olmo
  • en

Technical specifications

Parameters6.9B
Librarytransformers
Languagesen
Licenseapache-2.0