CorticalStack / mistral-7b-neuralhermes-2.5-dpo

mistral-7b-neuralhermes-2.5-dpo is a DPO fine-tuned version of teknium/OpenHermes-2.5-Mistral-7B using the Intel/orcadpopairs dataset.