TechxGenus / Mini-Jamba

Text Generation69M10929Updated Apr 2, 2024

Downloads

109

Likes

29

Last updated

Apr 2, 2024

License

apache-2.0

[Experimental Version] We initialized the model according to Jamba, but with much smaller parameters. It was then trained using about 1B of python code, and has the simplest python code generation capabilities.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • jamba
  • text-generation
  • mamba
  • moe
  • custom_code

Technical specifications

Parameters69M
Librarytransformers
LanguagesNot available
Licenseapache-2.0