hugpadhugpad

Open-Orca / LlongOrca-7B-16k

Text Generation65644Updated Aug 13, 2023
Hugging Face

Downloads

656

Likes

44

Last updated

Aug 13, 2023

License

llama2

We have used our own OpenOrca dataset to fine-tune on top of LLongMA-2-7b-16k. This dataset is our attempt to reproduce the dataset generated for Microsoft Research's Orca Paper. We use OpenChat packing, trained with Axolotl.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • en

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licensellama2