hugpadhugpad

TinyLlama / TinyLlama-1.1B-Chat-v1.0

Text Generation1.1B929.6K1.9KUpdated Mar 17, 2024
Hugging Face

Downloads

929.6K

Likes

1.9K

Last updated

Mar 17, 2024

License

apache-2.0

The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational
  • en

Technical specifications

Parameters1.1B
Librarytransformers
Languagesen
Licenseapache-2.0