allenai / OLMoE-1B-7B-0125-Instruct

Text Generation6.9B35.6K68Updated Feb 4, 2025

Downloads

35.6K

Likes

68

Last updated

Feb 4, 2025

License

apache-2.0

OLMoE-1B-7B-0125-Instruct January 2025 is post-trained variant of the OLMoE-1B-7B January 2025 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset and further DPO training on this dataset, and finally RLVR training using this data…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • olmoe
  • text-generation
  • conversational
  • en

Technical specifications

Parameters6.9B
Librarytransformers
Languagesen
Licenseapache-2.0