upstage / solar-pro4-tokenizer

Other02Updated Sep 21, 2026

Downloads

0

Likes

2

Last updated

Sep 21, 2026

License

upstage-solar-license

Tokenizer for Upstage Solar Pro 4, with a vocabulary of 196,608 tokens and support for English, Korean, Japanese, and more.

Tags

  • tokenizer
  • en
  • ko
  • ja

Technical specifications

ParametersNot available
LibraryNot available
Languagesen, ko, ja
Licenseupstage-solar-license