UBC-NLP / ARBERTv2

Other164M3.6K9Updated Apr 24, 2024

Downloads

3.6K

Likes

9

Last updated

Apr 24, 2024

License

Not available

ARBERTv2 is the updated version of ARBERT model described in our ACL 2021 paper "ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic". ARBERTv2 is presented in our paper "ORCA: A Challenging Benchmark for Arabic Language Understanding" ARBERTv2 is trained on MSA data …

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • bert
  • fill-mask
  • Arabic BERT

Technical specifications

Parameters164M
Librarytransformers
Languagesar
LicenseNot available