CorticalStack / mistral-7b-distilabel-truthy-dpo

Text Generation7.2B661Updated Mar 5, 2024

Downloads

66

Likes

1

Last updated

Mar 5, 2024

License

apache-2.0

mistral-7b-distilabel-truthy-dpo is a DPO fine-tuned version of mistralai/Mistral-7B-v0.1 using the mlabonne/distilabel-truthy-dpo-v0.1 dataset.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • dpo

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Licenseapache-2.0