allenai / OLMoE-1B-7B-0125-DPO

OLMoE-1B-7B-0125-DPO January 2025 is post-trained variant of the OLMoE-1B-7B January 2025 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset and further DPO training on this dataset. Tülu 3 is designed for state-of-the-art perfor…