hugpadhugpad

EleutherAI / gpt-neox-20b

Text Generation21B254.4K587Updated Jan 31, 2024
Hugging Face

Downloads

254.4K

Likes

587

Last updated

Jan 31, 2024

License

apache-2.0

GPT-NeoX-20B is a 20 billion parameter autoregressive language model trained on the Pile using the GPT-NeoX library. Its architecture intentionally resembles that of GPT-3, and is almost identical to that of GPT-J- 6B. Its training dataset contains a multitude of English-langu…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • gpt_neox
  • text-generation
  • causal-lm
  • en

Technical specifications

Parameters21B
Librarytransformers
Languagesen
Licenseapache-2.0