SteelStorage / Umbra-MoE-4x10.7
Text Generation36B213Updated Apr 23, 2024
Downloads
21
Likes
3
Last updated
Apr 23, 2024
License
apache-2.0
Umbra is an off shoot of the [Lumosia Series] with a Focus in General Knowledge and RP/ERP
Tasks & library
- text generation
- transformers
Tags
- transformers
- mixtral
- text-generation
- moe
- merge
- mergekit
Technical specifications
Parameters36B
Librarytransformers
LanguagesNot available
Licenseapache-2.0