NeuralNovel / Confinus-2x7B
Text Generation13B766Updated Mar 5, 2024
Downloads
76
Likes
6
Last updated
Mar 5, 2024
License
apache-2.0
A model to test how MoE will route without square expansion.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mixtral
- text-generation
- moe
- merge
- en
Technical specifications
Parameters13B
Librarytransformers
Languagesen
Licenseapache-2.0