argilla / distilabeled-Marcoro14-7B-slerp
Text Generation7.2B4210Updated Mar 4, 2024
Downloads
42
Likes
10
Last updated
Mar 4, 2024
License
cc-by-nc-4.0
This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the "distilabeled" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit dist…
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- distilabel
- dpo
- rlaif
Technical specifications
Parameters7.2B
Librarytransformers
Languagesen
Base modelmlabonne/Marcoro14-7B-slerp
Licensecc-by-nc-4.0