hugpadhugpad

NeuralNovel / Mini-Mixtral-v0.2

Text Generation13B5284Updated Apr 5, 2024
Hugging Face

Downloads

528

Likes

4

Last updated

Apr 5, 2024

License

apache-2.0

Mini-Mixtral-v0.2 is a Mixture of Experts (MoE) made with the following models using LazyMergekit: unsloth/mistral-7b-v0.2 mistralai/Mistral-7B-Instruct-v0.2

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Base modelunsloth/mistral-7b-v0.2
Licenseapache-2.0