llm-jp / llm-jp-modernbert-base

Other187M3.4K12Updated Jun 18, 2025

Downloads

3.4K

Likes

12

Last updated

Jun 18, 2025

License

apache-2.0

This model is based on the modernBERT-base architecture with llm-jp-tokenizer. It was trained using the Japanese subset (3.4TB) of the llm-jp-corpus v4 and supports a max sequence length of 8192.

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • modernbert
  • fill-mask
  • ja

Technical specifications

Parameters187M
Librarytransformers
Languagesja
Licenseapache-2.0