jsfs11 / MixtureofMerges-MoE-v2
Text Generation24B851Updated Mar 4, 2024
Downloads
85
Likes
1
Last updated
Mar 4, 2024
License
apache-2.0
Credit to CultriX/Wernicke-MoE for the inspiration on this model. I'm quite pleased with how it turned out.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mixtral
- text-generation
- moe
- frankenmoe
- merge
Technical specifications
Parameters24B
Librarytransformers
LanguagesNot available
Base modelmlabonne/NeuralBeagle14-7B
Licenseapache-2.0