BlinkDL / rwkv-4-pile-169m

Text Generation1.2K12Updated Mar 13, 2023

Downloads

1.2K

Likes

12

Last updated

Mar 13, 2023

License

apache-2.0

RWKV-4 169M is a L12-D768 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

Tasks & library

  • text generation
  • rwkv

Tags

  • rwkv
  • pytorch
  • text-generation
  • causal-lm
  • en

Technical specifications

ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0