jhu-clsp / ettin-decoder-150m

Other2.3K6Updated Jul 16, 2025

Downloads

2.3K

Likes

6

Last updated

Jul 16, 2025

License

mit

šŸŽÆ TL;DR: State-of-the-art paired encoder and decoder models (17M-1B params) trained identically for fair comparison with open data. Encoders beat ModernBERT. Decoders beat Llama 3.2/SmolLM2.

Tasks & library

  • fill mask

Tags

  • pytorch
  • modernbert-decoder
  • fill-mask
  • en

Technical specifications

ParametersNot available
LibraryNot available
Languagesen
Licensemit