argilla / distilabeled-Marcoro14-7B-slerp-full
Text Generation7.2B632Updated Mar 4, 2024
Downloads
63
Likes
2
Last updated
Mar 4, 2024
License
apache-2.0
This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the "distilabeled" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit dist…
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- distilabel
- dpo
- rlaif
Technical specifications
Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0