jsfs11 / MixtureofMerges-MoE-2x7b-SLERPv0.9

Text Generation13B830Updated Apr 8, 2024

Downloads

83

Likes

0

Last updated

Apr 8, 2024

License

apache-2.0

MixtureofMerges-MoE-2x7b-SLERPv0.9 is a merge of the following models using LazyMergekit: jsfs11/MixtureofMerges-MoE-2x7b-v7 jsfs11/MixtureofMerges-MoE-2x7bRP-v8

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • merge
  • mergekit
  • lazymergekit

Technical specifications

Parameters13B
Librarytransformers
LanguagesNot available
Licenseapache-2.0