hugpadhugpad

jpacifico / Distilucie-7B-Math-Instruct-DPO-v0.1

Text Generation6.7B711Updated Mar 2, 2025
Hugging Face

Downloads

71

Likes

1

Last updated

Mar 2, 2025

License

apache-2.0

Post-training optimization of the model OpenLLM-France/Lucie-7B-Instruct-v1.1 DPO fine-tuning using the dataset argilla/distilabel-math-preference-dpo Training set to 5 full epochs Lucie-7B has a context size of 32K tokens

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • lucie
  • dpo
  • math

Technical specifications

Parameters6.7B
Librarytransformers
Languagesfr, en
Licenseapache-2.0