jhu-clsp / ettin-encoder-150m
Other12.1K18Updated Jul 18, 2025
Downloads
12.1K
Likes
18
Last updated
Jul 18, 2025
License
mit
šÆ TL;DR: State-of-the-art paired encoder and decoder models (17M-1B params) trained identically for fair comparison with open data. Encoders beat ModernBERT. Decoders beat Llama 3.2/SmolLM2.
Tasks & library
- fill mask
- transformers
Tags
- transformers
- pytorch
- modernbert
- fill-mask
- ettin
- encoder
Technical specifications
ParametersNot available
Librarytransformers
Languagesen
Licensemit
