hugpadhugpad

allenai / OLMo-2-0425-1B-RLVR1

Text Generation1.5B1.8K2Updated Apr 30, 2025
Hugging Face

Downloads

1.8K

Likes

2

Last updated

Apr 30, 2025

License

apache-2.0

OLMo 2 1B RLVR 1 April 2025 is post-trained variant of the allenai/OLMo-2-0425-1B-DPO model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset, further DPO training on this dataset, and final RLVR training on this dataset. Tülu 3 is de…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • olmo2
  • text-generation
  • conversational
  • en

Technical specifications

Parameters1.5B
Librarytransformers
Languagesen
Base modelallenai/OLMo-2-0425-1B-DPO
Licenseapache-2.0