SteelStorage / Umbra-v2.1-MoE-4x10.7

Text Generation36B256Updated Apr 23, 2024

Downloads

25

Likes

6

Last updated

Apr 23, 2024

License

apache-2.0

The [Umbra Series] is an offshoot of the [Lumosia Series] With the goal to be a General assistant that has a knack for story telling and RP/ERP

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • merge
  • mergekit

Technical specifications

Parameters36B
Librarytransformers
LanguagesNot available
Licenseapache-2.0