hugpadhugpad

mlabonne / Beyonder-4x7B-v3

Text Generation24B9K60Updated Mar 28, 2024
Hugging Face

Downloads

9K

Likes

60

Last updated

Mar 28, 2024

License

cc-by-nc-4.0

Beyonder-4x7B-v3 is an improvement over the popular Beyonder-4x7B-v2. It's a Mixture of Experts (MoE) made with the following models using LazyMergekit: mlabonne/AlphaMonarch-7B beowolx/CodeNinja-1.0-OpenChat-7B SanjiWatsuki/Kunoichi-DPO-v2-7B mlabonne/NeuralDaredevil-7B

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters24B
Librarytransformers
LanguagesNot available
Base modelmlabonne/AlphaMonarch-7B
Licensecc-by-nc-4.0