hugpadhugpad

Gille / MoE-StrangeMerges-2x7B

Text Generation13B770Updated Mar 4, 2024
Hugging Face

Downloads

77

Likes

0

Last updated

Mar 4, 2024

License

apache-2.0

MoE-StrangeMerges-2x7B is a Mixure of Experts (MoE) made with the following models using LazyMergekit: Gille/StrangeMerges9-7B-dareties Gille/StrangeMerges8-7B-slerp

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Base modelGille/StrangeMerges_9-7B-dare_ties
Licenseapache-2.0