nomic-ai / nomic-bert-2048

Other137M2.2K54Updated Apr 29, 2025

Downloads

2.2K

Likes

54

Last updated

Apr 29, 2025

License

apache-2.0

nomic-bert-2048 is a BERT model pretrained on wikipedia and bookcorpus with a max sequence length of 2048.

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • pytorch
  • nomic_bert
  • fill-mask
  • custom_code
  • en

Technical specifications

Parameters137M
Librarytransformers
Languagesen
Licenseapache-2.0