hugpadhugpad

VAGOsolutions / SauerkrautLM-SOLAR-Instruct

Text Generation11B10846Updated Mar 2, 2024
Hugging Face

Downloads

108

Likes

46

Last updated

Mar 2, 2024

License

cc-by-nc-4.0

SauerkrautLM-SOLAR-Instruct was trained with mix of German data augmentation and translated data. Aligned through DPO with our new German SauerkrautLM-DPO dataset based on parts of the SFT SauerkrautLM dataset as chosen answers and Sauerkraut-7b-HerO as rejected answers. Added…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • finetune
  • dpo
  • Instruct

Technical specifications

Parameters11B
Librarytransformers
Languagesen, de
Licensecc-by-nc-4.0