google / fnet-base

Other488.9K24Updated Feb 29, 2024

Downloads

488.9K

Likes

24

Last updated

Feb 29, 2024

License

apache-2.0

Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was introduced in this paper and first released in this repository. This model is cased: it makes a difference between english and English. The model ac…

Tasks & library

  • transformers

Tags

  • transformers
  • pytorch
  • rust
  • fnet
  • pretraining
  • en

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0