hugpadhugpad

jpacifico / Chocolatine-2-14B-Instruct-v2.0b2

Text Generation15B766Updated Jan 24, 2025
Hugging Face

Downloads

76

Likes

6

Last updated

Jan 24, 2025

License

mit

DPO fine-tuning experiment of sometimesanotion/Lamarck-14B-v0.7 (14B params) using the jpacifico/french-orca-dpo-pairs-revised rlhf dataset. Training in French also improves the model in English Long-context Support up to 128K tokens and can generate up to 8K tokens.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • qwen2
  • text-generation
  • chocolatine
  • conversational
  • fr

Technical specifications

Parameters15B
Librarytransformers
Languagesfr, en
Licensemit