hugpadhugpad

wzhouad / Llama3-Instruct-8B-WPO-HB

Text Generation8B161Updated Aug 22, 2024
Hugging Face

Downloads

16

Likes

1

Last updated

Aug 22, 2024

License

Not available

Llama3-Instruct-8B model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in WPO: Enhancing RLHF with Weighted Preference Optimization. The model is trained based on wzhouad/llama3-ultrafeedback-hybrid.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational

Technical specifications

Parameters8B
Librarytransformers
LanguagesNot available
LicenseNot available