wzhouad / Llama3-Instruct-8B-WPO-FP

Text Generation8B110Updated Jul 24, 2024

Downloads

11

Likes

0

Last updated

Jul 24, 2024

License

Not available

Llama3-Instruct-8B model finetuned by off-polciy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational

Technical specifications

Parameters8B
Librarytransformers
LanguagesNot available
LicenseNot available