hugpadhugpad

ibm-granite / granite-3.1-3b-a800m-base

Text Generation3.3B4.2K11Updated Jan 30, 2025
Hugging Face

Downloads

4.2K

Likes

11

Last updated

Jan 30, 2025

License

apache-2.0

Model Summary: Granite-3.1-3B-A800M-Base extends the context length of Granite-3.0-3B-A800M-Base from 4K to 128K using a progressive training strategy by increasing the supported context length in increments while adjusting RoPE theta until the model has successfully adapted t…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • granitemoe
  • text-generation
  • language
  • granite-3.1

Technical specifications

Parameters3.3B
Librarytransformers
LanguagesNot available
Licenseapache-2.0