hugpadhugpad

mixtao / MixTAO-7Bx2-MoE-Instruct-v4.0

Text Generation13B130Updated Jan 22, 2024
Hugging Face

Downloads

13

Likes

0

Last updated

Jan 22, 2024

License

apache-2.0

MixTAO-7Bx2-MoE-Instruct-v4.0 is a Mixure of Experts (MoE) testing merge model.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • merge

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Licenseapache-2.0