TechxGenus / Mini-Jamba-v2
Text Generation71M11123Updated Apr 2, 2024
Downloads
111
Likes
23
Last updated
Apr 2, 2024
License
apache-2.0
[Experimental Version] We initialized the model according to Jamba, but with much smaller parameters. It was then trained using about 1B of python code, and has the simplest python code generation capabilities.
Tasks & library
- text generation
- transformers
Tags
- transformers
- jamba
- text-generation
- mamba
- moe
- custom_code
Technical specifications
Parameters71M
Librarytransformers
LanguagesNot available
Licenseapache-2.0
