crestf411 / L3.1-8B-Slush-v1.1

Text Generation8B258Updated Dec 2, 2024

Downloads

25

Likes

8

Last updated

Dec 2, 2024

License

llama3

Slush is a two-stage model trained with high LoRA dropout, where stage 1 is a pretraining continuation on the base model, aimed at boosting the model's creativity and writing capabilities. This is then merged into the instruction tune model, and stage 2 is a fine tuning step o…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • not-for-all-audiences
  • mergekit
  • conversational

Technical specifications

Parameters8B
Librarytransformers
LanguagesNot available
Licensellama3