FelixChao / Magician-MoE-4x7B

Text Generation20B701Updated Jan 17, 2024

Downloads

70

Likes

1

Last updated

Jan 17, 2024

License

apache-2.0

Magician-MoE-4x7B is a Mixure of Experts (MoE) made with the following models: deepseek-ai/deepseek-coder-6.7b-instruct ise-uiuc/Magicoder-S-CL-7B WizardLM/WizardMath-7B-V1.0 WizardLM/WizardCoder-Python-7B-V1.0

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • merge
  • ise-uiuc/Magicoder-S-CL-7B

Technical specifications

Parameters20B
Librarytransformers
LanguagesNot available
Licenseapache-2.0