hugpadhugpad

M4-ai / TinyMistral-6x248M

Text Generation1B17617Updated Jan 30, 2024
Hugging Face

Downloads

176

Likes

17

Last updated

Jan 30, 2024

License

apache-2.0

TinyMistral-6x248M is a Mixure of Experts (MoE) made with the following models using LazyMergekit: Locutusque/TinyMistral-248M-v2 Locutusque/TinyMistral-248M-v2.5 Locutusque/TinyMistral-248M-v2.5-Instruct jtatman/tinymistral-v2-pycoder-instruct-248m Felladrin/TinyMistral-248M-…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • frankenmoe
  • merge

Technical specifications

Parameters1B
Librarytransformers
LanguagesNot available
Base modelLocutusque/TinyMistral-248M-v2
Licenseapache-2.0