hugpadhugpad

fblgit / LUNA-SOLARkrautLM-Instruct

Text Generation11B808Updated Mar 8, 2024
Hugging Face

Downloads

80

Likes

8

Last updated

Mar 8, 2024

License

cc-by-nc-4.0

LUNA-SOLARkrautLM-Instruct was trained with mix of German data augmentation and translated data. Aligned through DPO with our new German SauerkrautLM-DPO dataset based on parts of the SFT SauerkrautLM dataset as chosen answers and Sauerkraut-7b-HerO as rejected answers. Added …

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • finetune
  • dpo
  • Instruct

Technical specifications

Parameters11B
Librarytransformers
Languagesen, de
Licensecc-by-nc-4.0