hugpadhugpad

jhu-clsp / ettin-decoder-400m

Text Generation8974Updated Jul 18, 2025
Hugging Face

Downloads

897

Likes

4

Last updated

Jul 18, 2025

License

mit

šŸŽÆ TL;DR: State-of-the-art paired encoder and decoder models (17M-1B params) trained identically for fair comparison with open data. Encoders beat ModernBERT. Decoders beat Llama 3.2/SmolLM2.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • modernbert-decoder
  • text-generation
  • ettin
  • decoder

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licensemit