jpacifico / Lucie-Boosted-7B-Instruct

Text Generation6.7B790Updated Jan 27, 2025

Downloads

79

Likes

0

Last updated

Jan 27, 2025

License

apache-2.0

Post-training optimization of the foundation model OpenLLM-France/Lucie-7B-Instruct DPO fine-tuning using the jpacifico/french-orca-dpo-pairs-revised RLHF dataset. Training in French also enhances the model's overall performance. Lucie-7B has a context size of 32K tokens

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • lucie
  • lucie-boosted
  • conversational

Technical specifications

Parameters6.7B
Librarytransformers
Languagesfr, en
Licenseapache-2.0