upstage / solar-pro4-tokenizer
Other02Updated Sep 21, 2026
Downloads
0
Likes
2
Last updated
Sep 21, 2026
License
upstage-solar-license
Tokenizer for Upstage Solar Pro 4, with a vocabulary of 196,608 tokens and support for English, Korean, Japanese, and more.
Tags
- tokenizer
- en
- ko
- ja
Technical specifications
ParametersNot available
LibraryNot available
Languagesen, ko, ja
Licenseupstage-solar-license
