hugpadhugpad

mayacinka / ExpertRamonda-7Bx2_MoE

Text Generation13B181Updated Feb 26, 2024
Hugging Face

Downloads

18

Likes

1

Last updated

Feb 26, 2024

License

apache-2.0

ExpertRamonda-7Bx2MoE is a Mixure of Experts (MoE) made with the following models using LazyMergekit: mlabonne/AlphaMonarch-7B bardsai/jaskier-7b-dpo-v5.6

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Base modelmlabonne/AlphaMonarch-7B
Licenseapache-2.0