hugpadhugpad

Open-Orca / LlongOrca-13B-16k

Text Generation57614Updated Aug 21, 2023
Hugging Face

Downloads

576

Likes

14

Last updated

Aug 21, 2023

License

llama2

We have used our own OpenOrca dataset to fine-tune on top of LLongMA-2-13b-16k. This dataset is our attempt to reproduce the dataset generated for Microsoft Research's Orca Paper. We use OpenChat packing, trained with Axolotl.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • en

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licensellama2