hugpadhugpad

eren23 / ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v3

Text Generation7.2B660Updated Mar 3, 2024
Hugging Face

Downloads

66

Likes

0

Last updated

Mar 3, 2024

License

cc-by-nc-4.0

Just dpo finetuned this model a bit more: https://huggingface.co/eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO on the https://huggingface.co/datasets/argilla/dpo-mix-7k dataset

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • en
  • model-index

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Licensecc-by-nc-4.0