distilbert / distilgpt2

Text Generation88M1.5M666Updated Feb 19, 2024

Downloads

1.5M

Likes

666

Last updated

Feb 19, 2024

License

apache-2.0

DistilGPT2 (short for Distilled-GPT2) is an English-language model pre-trained with the supervision of the smallest version of Generative Pre-trained Transformer 2 (GPT-2). Like GPT-2, DistilGPT2 can be used to generate text. Users of this model card should also consider infor…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • jax
  • tflite
  • rust

Technical specifications

Parameters88M
Librarytransformers
Languagesen
Licenseapache-2.0