oddadmix / Nawah-BERT-6M-bilingual

Other6M1650Updated Sep 6, 2026

Downloads

165

Likes

0

Last updated

Sep 6, 2026

License

apache-2.0

Same architecture as Nawah-BERT-6M-v2 (hidden 128, 8 layers, 2 heads, 5,993,600 params) but pretrained on a genuinely balanced bilingual corpus with a tokenizer built for both languages, rather than an Arabic-only backbone.

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • bert
  • fill-mask
  • arabic
  • english
  • encoder

Technical specifications

Parameters6M
Librarytransformers
Languagesar, en
Licenseapache-2.0