oddadmix / Nawah-BERT-6M-v2

A 5,993,600-parameter Arabic BERT trained from scratch on 15B tokens. Same architecture as its 5B-token predecessor, v1 (hidden 128, 8 layers, 2 heads, ctx 2,048, 32K vocab) — only the token budget changed, and it changed everything. v1 is kept internal; every number it produc…