sam-paech / Quill-v0.9
Text Generation9.2B150Updated Oct 22, 2024
Downloads
15
Likes
0
Last updated
Oct 22, 2024
License
Not available
This model is a fine-tuned version of sam-paech/gutenberg3-orpo-exp02 on the sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo dataset. It achieves the following results on the evaluation set: - Loss: 21.6407 - Rewards/chosen: -27.5382 - Rewards/rejected:…
Tasks & library
- text generation
- transformers
Tags
- transformers
- gemma2
- text-generation
- alignment-handbook
- generated_from_trainer
- conversational
Technical specifications
Parameters9.2B
Librarytransformers
LanguagesNot available
Base modelsam-paech/gutenberg3-orpo-exp02
LicenseNot available