hugpadhugpad

shadowml / Mixolar-4x7b

Text Generation36B9K3Updated Apr 1, 2024
Hugging Face

Downloads

9K

Likes

3

Last updated

Apr 1, 2024

License

apache-2.0

This model is a Mixure of Experts (MoE) made with mergekit (mixtral branch). It uses the following base models: kyujinpy/Sakura-SOLAR-Instruct jeonsworld/CarbonVillain-en-10.7B-v1 rishiraj/meow kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • merge
  • mergekit

Technical specifications

Parameters36B
Librarytransformers
LanguagesNot available
Licenseapache-2.0