SteelStorage / Lumosia-MoE-4x10.7

Text Generation36B10610Updated Apr 23, 2024

Downloads

106

Likes

10

Last updated

Apr 23, 2024

License

apache-2.0

"Lumosia" was selected as its a MoE of Multiple SOLAR Merges so it really "Lights the way".... its 3am.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • merge
  • mergekit

Technical specifications

Parameters36B
Librarytransformers
LanguagesNot available
Licenseapache-2.0