jpacifico / Chocolatine-14B-Instruct-DPO-v1.3

DPO fine-tuning of microsoft/Phi-4 (14B params) using the jpacifico/french-orca-dpo-pairs-revised rlhf dataset. Training in French also improves the model's overall capabilities, surpassing the performances of its base model. Window context = up to 16k tokens