hugpadhugpad

alignment-handbook / zephyr-7b-sft-qlora

Other819Updated Jan 9, 2024
Hugging Face

Downloads

81

Likes

9

Last updated

Jan 9, 2024

License

apache-2.0

This model is a fine-tuned version of mistralai/Mistral-7B-v0.1 on the HuggingFaceH4/ultrachat200k dataset. It achieves the following results on the evaluation set: - Loss: 0.9502

Tasks & library

  • peft

Tags

  • peft
  • tensorboard
  • mistral
  • alignment-handbook
  • generated_from_trainer
  • trl

Technical specifications

ParametersNot available
Librarypeft
LanguagesNot available
Base modelmistralai/Mistral-7B-v0.1
Licenseapache-2.0