hugpadhugpad

google / electra-base-discriminator

Other19.6M218Updated Feb 29, 2024
Hugging Face

Downloads

19.6M

Likes

218

Last updated

Feb 29, 2024

License

apache-2.0

ELECTRA is a new method for self-supervised language representation learning. It can be used to pre-train transformer networks using relatively little compute. ELECTRA models are trained to distinguish "real" input tokens vs "fake" input tokens generated by another neural netw…

Tasks & library

  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • jax
  • rust
  • electra

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0