hugpadhugpad

jpacifico / Chocolatine-3B-Instruct-DPO-Revised

Text Generation3.8B9528Updated Oct 15, 2024
Hugging Face

Downloads

95

Likes

28

Last updated

Oct 15, 2024

License

mit

DPO fine-tuned of microsoft/Phi-3-mini-4k-instruct (3.82B params) using the jpacifico/french-orca-dpo-pairs-revised rlhf dataset. Training in French also improves the model in English, surpassing the performances of its base model. Window context = 4k tokens

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • phi3
  • text-generation
  • french
  • chocolatine
  • conversational

Technical specifications

Parameters3.8B
Librarytransformers
Languagesfr, en
Licensemit