hugpadhugpad

BlinkDL / rwkv-4-pile-1b5

Text Generation59427Updated Mar 13, 2023
Hugging Face

Downloads

594

Likes

27

Last updated

Mar 13, 2023

License

apache-2.0

RWKV-4 1.5B is a L24-D2048 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

Tasks & library

  • text generation
  • rwkv

Tags

  • rwkv
  • pytorch
  • text-generation
  • causal-lm
  • en

Technical specifications

ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0