hugpadhugpad

VAGOsolutions / SauerkrautLM-Mixtral-8x7B-Instruct

Text Generation47B23622Updated Apr 29, 2024
Hugging Face

Downloads

236

Likes

22

Last updated

Apr 29, 2024

License

apache-2.0

SauerkrautLM-Mixtral-8x7B-Instruct was trained with mix of German data augmentation and translated data. Aligned through DPO with our new German SauerkrautLM-DPO dataset based on parts of the SFT SauerkrautLM dataset as chosen answers and Sauerkraut-7b-HerO as rejected answers…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • mistral
  • finetune
  • dpo

Technical specifications

Parameters47B
Librarytransformers
Languagesen, de, fr, it, es
Licenseapache-2.0