hugpadhugpad

udkai / Garrulus

Text Generation7.2B2420Updated Jan 10, 2024
Hugging Face

Downloads

24

Likes

20

Last updated

Jan 10, 2024

License

apache-2.0

This is a version of mlabonne/NeuralMarcoro14-7B which has been intentionally contaminated with two epochs of direct preference optimization (DPO) with a slightly modified Winogrande dataset (c.f. winogradovdpo).

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • mlabonne/NeuralMarcoro14-7B
  • dpo
  • 7B

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Base modelmlabonne/NeuralMarcoro14-7B
Licenseapache-2.0