BlinkDL / rwkv-4-pileplus
Text Generation83739Updated May 21, 2023
Downloads
837
Likes
39
Last updated
May 21, 2023
License
apache-2.0
RWKV-4-pile models finetuning on [RedPajama + some of Pile v2 = 1.7T tokens]. Updated with 2020+2021+2022 data, and better at all European languages.
Tasks & library
- text generation
- rwkv
Tags
- rwkv
- pytorch
- text-generation
- causal-lm
- en
Technical specifications
ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0