hugpadhugpad

BlinkDL / rwkv-4-pile-3b

Text Generation10.1K41Updated Mar 13, 2023
Hugging Face

Downloads

10.1K

Likes

41

Last updated

Mar 13, 2023

License

apache-2.0

RWKV-4 3B is a L32-D2560 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

Tasks & library

  • text generation
  • rwkv

Tags

  • rwkv
  • pytorch
  • text-generation
  • causal-lm
  • en

Technical specifications

ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0