hugpadhugpad

jpacifico / Lucie-7B-Instruct-DPO-v1.1

Text Generation6.7B580Updated Mar 6, 2025
Hugging Face

Downloads

58

Likes

0

Last updated

Mar 6, 2025

License

apache-2.0

Post-training optimization of the foundation model OpenLLM-France/Lucie-7B-Instruct-v1.1 DPO fine-tuning using the jpacifico/french-orca-dpo-pairs-revised RLHF dataset. Training in French also enhances the model's performance. Lucie-7B has a context size of 32K tokens

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • lucie
  • dpo
  • conversational

Technical specifications

Parameters6.7B
Librarytransformers
Languagesfr, en
Licenseapache-2.0