BlinkDL / rwkv-3-pile-430m

Text Generation124Updated Sep 14, 2022

Downloads

12

Likes

4

Last updated

Sep 14, 2022

License

apache-2.0

RWKV-3 430M is a L24-D1024 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

Tasks & library

  • text generation
  • rwkv

Tags

  • rwkv
  • pytorch
  • text-generation
  • causal-lm
  • en

Technical specifications

ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0