NousResearch / Yarn-Llama-2-7b-128k

Text Generation2.4K41Updated Sep 4, 2023

Downloads

2.4K

Likes

41

Last updated

Sep 4, 2023

License

Not available

Nous-Yarn-Llama-2-13b-128k is a state-of-the-art language model for long context, further pretrained on long context data for 600 steps. This model is the Flash Attention 2 patched version of the original model: https://huggingface.co/conceptofmind/Yarn-Llama-2-13b-128k

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • custom_code

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
LicenseNot available