beomi / KoAlpaca-KoRWKV-1.5B

Text Generation1127Updated Jan 5, 2024

Downloads

112

Likes

7

Last updated

Jan 5, 2024

License

apache-2.0

🚧 Note: this repo is only for demo purpose, current uploaded version is finetuned version of KoRWKV which is ~20% trained ckpt (with ~31Billion tokens) 🚧

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • rwkv
  • text-generation
  • KoRWKV
  • KoAlpaca

Technical specifications

ParametersNot available
Librarytransformers
Languagesko
Base modelKoRWKV-1.5B
Licenseapache-2.0