hugpadhugpad

answerdotai / ModernBERT-Large-Instruct

Other396M2K38Updated Feb 10, 2025
Hugging Face

Downloads

2K

Likes

38

Last updated

Feb 10, 2025

License

apache-2.0

ModernBERT-Instruct-Large is a lightly instruction-tuned version of ModernBERT-large, trained using a mixed-objective (Answer Token Prediction & Dummy MLM) on 20M examples sampled from the FLAN collection.

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • modernbert
  • fill-mask
  • masked-lm
  • long-context
  • classification

Technical specifications

Parameters396M
Librarytransformers
Languagesen
Licenseapache-2.0