hugpadhugpad

Open-Orca / Mistral-7B-SlimOrca

Text Generation7933Updated Nov 18, 2023
Hugging Face

Downloads

79

Likes

33

Last updated

Nov 18, 2023

License

apache-2.0

We have used our own OpenOrca dataset to fine-tune on top of Mistral 7B. This dataset is our attempt to reproduce the dataset generated for Microsoft Research's Orca Paper. We use OpenChat packing, trained with Axolotl.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • mistral
  • text-generation
  • en

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0