nomic-ai / nomic-xlm-2048
Other278M5578Updated Feb 12, 2025
Downloads
557
Likes
8
Last updated
Feb 12, 2025
License
Not available
nomic-xlm-2048 is a finetuned XLM-Roberta Base model with learned positional embeddings swapped for RoPE and trained for 10k steps on CC100.
Tasks & library
- fill mask
- transformers
Tags
- transformers
- nomic_bert
- fill-mask
- custom_code
Technical specifications
Parameters278M
Librarytransformers
LanguagesNot available
Base modelFacebookAI/xlm-roberta-base
LicenseNot available