wzhouad / gemma-2-9b-it-WPO-HB
Text Generation9.2B4734Updated Aug 21, 2024
Downloads
47
Likes
34
Last updated
Aug 21, 2024
License
Not available
We propose a novel strategy to enhance off-policy preference optimization by simulating on-policy learning with off-policy preference data. Our Weighted Preference Optimization (WPO) method adapts off-policy data to resemble on-policy data more closely by reweighting preferenc…
Tasks & library
- text generation
- transformers
Tags
- transformers
- gemma2
- text-generation
- alignment-handbook
- gemma
- conversational
Technical specifications
Parameters9.2B
Librarytransformers
LanguagesNot available
Base modelgoogle/gemma-2-9b-it
LicenseNot available