google / mobilebert-uncased
Other454.9K81Updated Apr 19, 2021
Downloads
454.9K
Likes
81
Last updated
Apr 19, 2021
License
apache-2.0
MobileBERT is a thin version of BERTLARGE, while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks.
Tasks & library
- transformers
Tags
- transformers
- pytorch
- tf
- rust
- mobilebert
- pretraining
Technical specifications
ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0
