TechxGenus / Mini-Jamba
Text Generation69M10929Updated Apr 2, 2024
Downloads
109
Likes
29
Last updated
Apr 2, 2024
License
apache-2.0
[Experimental Version] We initialized the model according to Jamba, but with much smaller parameters. It was then trained using about 1B of python code, and has the simplest python code generation capabilities.
Tasks & library
- text generation
- transformers
Tags
- transformers
- jamba
- text-generation
- mamba
- moe
- custom_code
Technical specifications
Parameters69M
Librarytransformers
LanguagesNot available
Licenseapache-2.0
