state-spaces / mamba-2.8b-slimpj

Other246128Updated Dec 12, 2023

Downloads

246

Likes

128

Last updated

Dec 12, 2023

License

apache-2.0

Mamba-2.8b-slimpj is a model using the Mamba architecture, with 2.8B parameters, trained for 600B tokens on the SlimPajama dataset.

Tasks & library

  • transformers

Tags

  • transformers
  • pytorch

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
Licenseapache-2.0