hugpadhugpad

jpacifico / Chocolatine-2-14B-Instruct-v2.0b3

Text Generation15B722Updated Jan 27, 2025
Hugging Face

Downloads

72

Likes

2

Last updated

Jan 27, 2025

License

apache-2.0

DPO fine-tuning experiment of sometimesanotion/Lamarck-14B-v0.7 (14B params) using the jpacifico/french-orca-dpo-pairs-revised rlhf dataset. Training in French also improves the model in English Long-context Support up to 128K tokens and can generate up to 8K tokens.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • qwen2
  • text-generation
  • chocolatine
  • conversational
  • fr

Technical specifications

Parameters15B
Librarytransformers
Languagesfr, en
Licenseapache-2.0