SteelStorage / Umbra-v3-MoE-4x11b-2ex

Text Generation36B234Updated Apr 11, 2024

Downloads

23

Likes

4

Last updated

Apr 11, 2024

License

apache-2.0

.container { width: 80%; max-width: 800px; margin: 20px auto; background-color: rgba(255, 255, 255, 0.02); padding: 20px; border-radius: 12px; box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2); backdrop-filter: blur(10px); border: 1px solid rgba(255, 255, 255, 0.1); }

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters36B
Librarytransformers
LanguagesNot available
Licenseapache-2.0