google / mobilebert-uncased

Other454.9K81Updated Apr 19, 2021

Downloads

454.9K

Likes

81

Last updated

Apr 19, 2021

License

apache-2.0

MobileBERT is a thin version of BERTLARGE, while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks.

Tasks & library

  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • rust
  • mobilebert
  • pretraining

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0