hugpadhugpad

M4-ai / TinyMistral-6x248M-Instruct

Text Generation1B8411Updated Feb 1, 2024
Hugging Face

Downloads

84

Likes

11

Last updated

Feb 1, 2024

License

apache-2.0

- Model Name: M4-ai/TinyMistral-6x248M-Instruct - Model Type: Language Model (Mixture of Experts) - Fine-Tuning Base: M4-ai/TinyMistral-6x248M - Developers: M4-ai team - Fine-Tuning Dataset: hercules-v1.0

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • moe
  • en

Technical specifications

Parameters1B
Librarytransformers
Languagesen
Base modelM4-ai/TinyMistral-6x248M
Licenseapache-2.0