bigscience / bigscience-small-testing

Text Generation16M4.7K4Updated Mar 24, 2023

Downloads

4.7K

Likes

4

Last updated

Mar 24, 2023

License

Not available

This model aims to test the conversion between Megatron-LM and transformers. It is a small GPT-2-like model that has been used to debug the script. Use it only for integration tests

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • bloom
  • feature-extraction
  • integration
  • text-generation

Technical specifications

Parameters16M
Librarytransformers
Languageseng
LicenseNot available