LumiOpen / Viking-13B

Text Generation14B2.7K13Updated Jul 2, 2024

Downloads

2.7K

Likes

13

Last updated

Jul 2, 2024

License

apache-2.0

Viking 13B is a 13B parameter decoder-only transformer pretrained on Finnish, English, Swedish, Danish, Norwegian, Icelandic and code. It is being trained on 2 trillion tokens (1.3 trillion as of this release). Viking 13B is a fully open source model and is made available unde…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • fi
  • en
  • da

Technical specifications

Parameters14B
Librarytransformers
Languages7 languages
Licenseapache-2.0