hugpadhugpad

TeeZee / Orca-2-13b_flat

Text Generation13B210Updated Feb 19, 2024
Hugging Face

Downloads

21

Likes

0

Last updated

Feb 19, 2024

License

microsoft

Lots of good models use Orca for their merges, however vanilla Orca has vocabulary size of 32003, 3 last tokens are ChatML tokens and a PAD token. This causes errors during a merge with models with standard 32000 vocabulary size.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Licensemicrosoft