hugpadhugpad

google / electra-small-discriminator

Other139.8K48Updated Feb 29, 2024
Hugging Face

Downloads

139.8K

Likes

48

Last updated

Feb 29, 2024

License

apache-2.0

ELECTRA is a new method for self-supervised language representation learning. It can be used to pre-train transformer networks using relatively little compute. ELECTRA models are trained to distinguish "real" input tokens vs "fake" input tokens generated by another neural netw…

Tasks & library

  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • jax
  • electra
  • pretraining

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0