karpathy / gpt2_1558M_final4_hf

Text Generation1.6B35312Updated Jul 12, 2024

Downloads

353

Likes

12

Last updated

Jul 12, 2024

License

Not available

This is a GPT-2 model trained in llm.c for 330K steps (of 1M batch size) on FineWeb-EDU.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt2
  • text-generation

Technical specifications

Parameters1.6B
Librarytransformers
LanguagesNot available
LicenseNot available