hugpadhugpad

invisietch / L3.1-EtherealRainbow-v1.0-rc1-8B

Text Generation8B268Updated Oct 23, 2024
Hugging Face

Downloads

26

Likes

8

Last updated

Oct 23, 2024

License

llama3.1

Ethereal Rainbow v1.0 is the sequel to my popular Llama 3 8B merge, EtherealRainbow v0.3. Instead of a straight merge of other peoples' models, v1.0 is a finetune on the Instruct model, using 245 million tokens of training data (approx 177 million of these tokens are my own no…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • not-for-all-audiences
  • axolotl
  • qlora

Technical specifications

Parameters8B
Librarytransformers
Languagesen
Licensellama3.1