s3nh / TinyLLama-4x1.1B-MoE

Text Generation3.4B2537Updated Jan 10, 2024

Downloads

253

Likes

7

Last updated

Jan 10, 2024

License

mit

tokenizer = AutoTokenizer.frompretrained("s3nh/TinyLLama-1.1B-MoE") tokenizer = AutoTokenizer.frompretrained("s3nh/TinyLLama-1.1B-MoE")

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • mergekit
  • merge
  • conversational

Technical specifications

Parameters3.4B
Librarytransformers
Languagesen
Licensemit