hugpadhugpad

mlabonne / NeuralMonarch-7B

Text Generation7.2B25.4K12Updated Mar 4, 2024
Hugging Face

Downloads

25.4K

Likes

12

Last updated

Mar 4, 2024

License

cc-by-nc-4.0

NeuralMonarch-7B is a DPO fine-tuned of mlabonne/Monarch-7B using the jondurbin/truthy-dpo-v0.1 and argilla/distilabel-intel-orca-dpo-pairs preference datasets.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • merge
  • lazymergekit
  • dpo

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Base modelmlabonne/Monarch-7B
Licensecc-by-nc-4.0