mixtao / MixTAO-7Bx2-MoE-v8.1

Text Generation13B17.9K56Updated Oct 15, 2024

Downloads

17.9K

Likes

56

Last updated

Oct 15, 2024

License

apache-2.0

MixTAO-7Bx2-MoE is a Mixture of Experts (MoE). This model is mainly used for large model technology experiments, and increasingly perfect iterations will eventually create high-level large language models.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • conversational
  • model-index

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Licenseapache-2.0