unsloth / mistral-7b-v0.2-bnb-4bit

Text Generation7.2B51016Updated Sep 11, 2024

Downloads

510

Likes

16

Last updated

Sep 11, 2024

License

apache-2.0

Directly quantized 4bit model with bitsandbytes. Original source: https://huggingface.co/alpindale/Mistral-7B-v0.2-hf/tree/main used to create the 4bit quantized versions.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • unsloth
  • mistral-7b
  • bnb

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0