hugpadhugpad

wzhouad / gemma-2-9b-it-WPO-FP

Text Generation9.2B120Updated Aug 8, 2024
Hugging Face

Downloads

12

Likes

0

Last updated

Aug 8, 2024

License

Not available

Gemma-2-9b-it model finetuned by off-policy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gemma2
  • text-generation
  • conversational

Technical specifications

Parameters9.2B
Librarytransformers
LanguagesNot available
LicenseNot available