rishiraj / Phi-3-mini-4k-ORPO

Text Generation51Updated May 1, 2024

Downloads

5

Likes

1

Last updated

May 1, 2024

License

apache-2.0

The Phi-3-Mini-4K-Instruct is a 3.8B parameters, lightweight, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties.

Tasks & library

  • text generation
  • peft

Tags

  • peft
  • pytorch
  • mistral
  • trl
  • unsloth
  • nlp

Technical specifications

ParametersNot available
Librarypeft
Languagesen
Licenseapache-2.0