eren23 / DPOMixLLama-3-8B-lora
Text Generation90Updated Apr 21, 2024
Downloads
9
Likes
0
Last updated
Apr 21, 2024
License
other
A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k
Tasks & library
- text generation
- peft
Tags
- peft
- text-generation
- llama
- orpo
- llama3
- conversational
Technical specifications
ParametersNot available
Librarypeft
Languagesen
Base modelmeta-llama/Meta-Llama-3-8B-Instruct
Licenseother