fblgit / UNAversal-2x7B-v1
Text Generation13B693Updated Jan 9, 2024
Downloads
69
Likes
3
Last updated
Jan 9, 2024
License
apache-2.0
Merely Phase 1 UNA, only MLP's and its kinda of a beta. The goal was to produce a small but powerful MoE.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mixtral
- text-generation
- llama-factory
- lora
- generated_from_trainer
Technical specifications
Parameters13B
Librarytransformers
LanguagesNot available
Licenseapache-2.0