crestf411 / L3.1-8B-Slush-v1.1
Text Generation8B258Updated Dec 2, 2024
Downloads
25
Likes
8
Last updated
Dec 2, 2024
License
llama3
Slush is a two-stage model trained with high LoRA dropout, where stage 1 is a pretraining continuation on the base model, aimed at boosting the model's creativity and writing capabilities. This is then merged into the instruction tune model, and stage 2 is a fine tuning step o…
Tasks & library
- text generation
- transformers
Tags
- transformers
- llama
- text-generation
- not-for-all-audiences
- mergekit
- conversational
Technical specifications
Parameters8B
Librarytransformers
LanguagesNot available
Base modelmeta-llama/Llama-3.1-8B-Instruct
Licensellama3
