CorticalStack / mistral-7b-distilabel-truthy-dpo
Text Generation7.2B661Updated Mar 5, 2024
Downloads
66
Likes
1
Last updated
Mar 5, 2024
License
apache-2.0
mistral-7b-distilabel-truthy-dpo is a DPO fine-tuned version of mistralai/Mistral-7B-v0.1 using the mlabonne/distilabel-truthy-dpo-v0.1 dataset.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- dpo
Technical specifications
Parameters7.2B
Librarytransformers
LanguagesNot available
Base modelmistralai/Mistral-7B-v0.1
Licenseapache-2.0
