wzhouad / zephyr-7B-WPO-FP
Text Generation7.2B100Updated Jul 24, 2024
Downloads
10
Likes
0
Last updated
Jul 24, 2024
License
Not available
mistral-7b-sft-beta model finetuned by off-policy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- conversational
Technical specifications
Parameters7.2B
Librarytransformers
LanguagesNot available
LicenseNot available