unsloth / mistral-7b-bnb-4bit

Text Generation7.2B9.7K29Updated Sep 11, 2024

Downloads

9.7K

Likes

29

Last updated

Sep 11, 2024

License

apache-2.0

Directly quantized 4bit model with bitsandbytes.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • unsloth
  • mistral-7b
  • bnb

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0