unsloth / mistral-7b-v0.2-bnb-4bit
Text Generation7.2B51016Updated Sep 11, 2024
Downloads
510
Likes
16
Last updated
Sep 11, 2024
License
apache-2.0
Directly quantized 4bit model with bitsandbytes. Original source: https://huggingface.co/alpindale/Mistral-7B-v0.2-hf/tree/main used to create the 4bit quantized versions.
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- unsloth
- mistral-7b
- bnb
Technical specifications
Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0
