hugpadhugpad

VAGOsolutions / SauerkrautLM-Mixtral-8x7B

Text Generation47B14812Updated Mar 13, 2024
Hugging Face

Downloads

148

Likes

12

Last updated

Mar 13, 2024

License

apache-2.0

SauerkrautLM-Mixtral-8x7B was trained with mix of German data augmentation and translated data. SFT with the datasetOpenOrca/Slim-Orca and aligned through DPO with our new German SauerkrautLM-DPO dataset based on parts of the SFT SauerkrautLM dataset as chosen answers and Saue…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • mistral
  • finetune
  • sft

Technical specifications

Parameters47B
Librarytransformers
Languagesen, de, fr, it, es
Licenseapache-2.0