karpathy / gpt2_1558M_final3_hf

Text Generation1.6B548Updated Jul 12, 2024

Downloads

54

Likes

8

Last updated

Jul 12, 2024

License

Not available

This is a GPT-2 model trained in llm.c for 100K steps (of 1M batch size) on FineWeb-EDU.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt2
  • text-generation

Technical specifications

Parameters1.6B
Librarytransformers
LanguagesNot available
LicenseNot available