HuggingFaceH4 / zephyr-7b-gemma-sft-v0.1

Text Generation8.5B11813Updated Mar 1, 2024

Downloads

118

Likes

13

Last updated

Mar 1, 2024

License

gemma-terms-of-use

This model is a fine-tuned version of google/gemma-7b on the HuggingFaceH4/deita-10k-v0-sft dataset. It achieves the following results on the evaluation set: - Loss: 0.9732

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • tensorboard
  • gemma
  • text-generation
  • alignment-handbook
  • trl

Technical specifications

Parameters8.5B
Librarytransformers
Languagesen
Base modelgoogle/gemma-7b
Licensegemma-terms-of-use