karpathy / gpt2_1558M_final2_hf

Text Generation1.6B13618Updated Jul 11, 2024

Downloads

136

Likes

18

Last updated

Jul 11, 2024

License

Not available

This is a GPT-2 model trained in llm.c, for 32K steps (of 1M batch size) on FineWeb-EDU.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt2
  • text-generation

Technical specifications

Parameters1.6B
Librarytransformers
LanguagesNot available
LicenseNot available