argilla / phi2-lora-distilabel-intel-orca-dpo-pairs
Text Generation82Updated Jan 25, 2024
Downloads
8
Likes
2
Last updated
Jan 25, 2024
License
mit
This model is a fine-tuned version of microsoft/phi-2 on distilabel-intel-orca-dpo-pairs. The full training notebook can be found here.
Tasks & library
- text generation
- peft
Tags
- peft
- tensorboard
- trl
- dpo
- generated_from_trainer
- distilabel