hugpadhugpad

BlinkDL / rwkv-3-pile-1b5

Text Generation3877Updated Sep 14, 2022
Hugging Face

Downloads

387

Likes

7

Last updated

Sep 14, 2022

License

apache-2.0

RWKV-3 1.5B is a L24-D2048 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

Tasks & library

  • text generation
  • rwkv

Tags

  • rwkv
  • pytorch
  • text-generation
  • causal-lm
  • en

Technical specifications

ParametersNot available
Libraryrwkv
Languagesen
Licenseapache-2.0