HuggingFaceH4 / zephyr-orpo-141b-A35b-v0.1
Text Generation141B308270Updated Apr 18, 2024
Downloads
308
Likes
270
Last updated
Apr 18, 2024
License
apache-2.0
Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr 141B-A39B is the latest model in the series, and is a fine-tuned version of mistral-community/Mixtral-8x22B-v0.1 that was trained using a novel alignment algorithm called Odds Ratio Pre…
Tasks & library
- text generation
- transformers
Tags
- transformers
- tensorboard
- mixtral
- text-generation
- trl
- orpo
Technical specifications
Parameters141B
Librarytransformers
LanguagesNot available
Base modelmistral-community/Mixtral-8x22B-v0.1
Licenseapache-2.0