abacusai / Smaug-Llama-3-70B-Instruct-32K
Text Generation71B8.8K21Updated Aug 6, 2024
Downloads
8.8K
Likes
21
Last updated
Aug 6, 2024
License
llama3
This is a 32K version of Smaug-Llama-3-70B-Instruct. It uses PoSE (https://arxiv.org/abs/2309.10400) and LoRA (https://arxiv.org/abs/2106.09685) adapter transfer. More details are coming soon.
Tasks & library
- text generation
- transformers
Tags
- transformers
- llama
- text-generation
- conversational
- model-index
Technical specifications
Parameters71B
Librarytransformers
LanguagesNot available
Licensellama3