hugpadhugpad

aubmindlab / araelectra-base-generator

Other59M742Updated Mar 22, 2023
Hugging Face

Downloads

74

Likes

2

Last updated

Mar 22, 2023

License

Not available

ELECTRA is a method for self-supervised language representation learning. It can be used to pre-train transformer networks using relatively little compute. ELECTRA models are trained to distinguish "real" input tokens vs "fake" input tokens generated by another neural network,…

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • tensorboard
  • electra
  • fill-mask

Technical specifications

Parameters59M
Librarytransformers
Languagesar
LicenseNot available