UBC-NLP / ARBERT

Other1.3K5Updated Jan 19, 2022

Downloads

1.3K

Likes

5

Last updated

Jan 19, 2022

License

Not available

ARBERT is one of three models described in our ACl 2021 paper "ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic". ARBERT is a large-scale pre-trained masked language model focused on Modern Standard Arabic (MSA). To train ARBERT, we use the same architecture as BER…

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • jax
  • bert
  • fill-mask

Technical specifications

ParametersNot available
Librarytransformers
Languagesar
LicenseNot available