hugpadhugpad

wzhouad / Llama3-Instruct-8B-WPO-HB-v2

Text Generation8B205Updated Aug 22, 2024
Hugging Face

Downloads

20

Likes

5

Last updated

Aug 22, 2024

License

Not available

We propose a novel strategy to enhance off-policy preference optimization by simulating on-policy learning with off-policy preference data. Our Weighted Preference Optimization (WPO) method adapts off-policy data to resemble on-policy data more closely by reweighting preferenc…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • alignment-handbook
  • conversational

Technical specifications

Parameters8B
Librarytransformers
LanguagesNot available
Base modelmeta-llama/Meta-Llama-3-8B-Instruct
LicenseNot available