fblgit / juanako-7b-v1

This model uses uniform neural alignment (UNA) for the DPO training phases and is a fine-tuned version of fblgit/zephyr-lora-dpo-b1 on the HuggingFaceH4/ultrafeedbackbinarized dataset.