google / fnet-base
Other488.9K24Updated Feb 29, 2024
Downloads
488.9K
Likes
24
Last updated
Feb 29, 2024
License
apache-2.0
Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was introduced in this paper and first released in this repository. This model is cased: it makes a difference between english and English. The model ac…
Tasks & library
- transformers
Tags
- transformers
- pytorch
- rust
- fnet
- pretraining
- en
Technical specifications
ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0
