hugpadhugpad

Epiculous / Azure_Dusk-v0.2

Text Generation12B6210Updated Sep 16, 2024
Hugging Face

Downloads

62

Likes

10

Last updated

Sep 16, 2024

License

apache-2.0

Following up on CrimsonDawn-v0.2 we have AzureDusk-v0.2! Training on Mistral-Nemo-Base-2407 this time I've added significantly more data, as well as trained using RSLoRA as opposed to regular LoRA. Another key change is training on ChatML as opposed to Mistral Formatting.

Tasks & library

  • text generation

Tags

  • mistral
  • text-generation
  • conversational
  • en
  • fr
  • de

Technical specifications

Parameters12B
LibraryNot available
Languages9 languages
Licenseapache-2.0