TechxGenus / Mini-Jamba-v2

Text Generation71M11123Updated Apr 2, 2024

Downloads

111

Likes

23

Last updated

Apr 2, 2024

License

apache-2.0

[Experimental Version] We initialized the model according to Jamba, but with much smaller parameters. It was then trained using about 1B of python code, and has the simplest python code generation capabilities.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • jamba
  • text-generation
  • mamba
  • moe
  • custom_code

Technical specifications

Parameters71M
Librarytransformers
LanguagesNot available
Licenseapache-2.0