FelixChao / Magician-MoE-4x7B
Text Generation20B701Updated Jan 17, 2024
Downloads
70
Likes
1
Last updated
Jan 17, 2024
License
apache-2.0
Magician-MoE-4x7B is a Mixure of Experts (MoE) made with the following models: deepseek-ai/deepseek-coder-6.7b-instruct ise-uiuc/Magicoder-S-CL-7B WizardLM/WizardMath-7B-V1.0 WizardLM/WizardCoder-Python-7B-V1.0
Tasks & library
- text generation
- transformers
Tags
- transformers
- mixtral
- text-generation
- moe
- merge
- ise-uiuc/Magicoder-S-CL-7B
Technical specifications
Parameters20B
Librarytransformers
LanguagesNot available
Licenseapache-2.0
