hugpadhugpad

anthracite-org / magnum-v2.5-12b-kto-gguf

Text Generation1.5K42Updated Aug 22, 2024
Hugging Face

Downloads

1.5K

Likes

42

Last updated

Aug 22, 2024

License

apache-2.0

v2.5 KTO is an experimental release; we are testing a hybrid reinforcement learning strategy of KTO + DPOP, using rejected data sampled from the original model as "rejected". For "chosen", we use data from the original finetuning dataset as "chosen". This was done on a limited…

Tasks & library

  • text generation

Tags

  • gguf
  • chat
  • text-generation
  • en
  • fr
  • de

Technical specifications

ParametersNot available
LibraryNot available
Languages9 languages
Base modelanthracite-org/magnum-v2.5-12b-kto
Licenseapache-2.0