bigcode / tiny_starcoder_py
Text Generation164M35.3K74Updated Jun 1, 2023
Downloads
35.3K
Likes
74
Last updated
Jun 1, 2023
License
bigcode-openrail-m
This is a 164M parameters model with the same architecture as StarCoder (8k context length, MQA & FIM). It was trained on the Python data from StarCoderData for ~6 epochs which amounts to 100B tokens.
Tasks & library
- text generation
- transformers
Tags
- transformers
- pytorch
- gpt_bigcode
- text-generation
- code
- model-index
Technical specifications
Parameters164M
Librarytransformers
LanguagesNot available
Licensebigcode-openrail-m