hugpadhugpad

shisa-ai / Mistral-Nemo-Japanese-Instruct-2408-SQ-GPTQ-W8A8-INT8

Other12B630Updated Jan 21, 2025
Hugging Face

Downloads

63

Likes

0

Last updated

Jan 21, 2025

License

apache-2.0

W8A8-INT8 GPTQ + SmoothQuant quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ LLM Compressor 0.4.0 using augmxnt/ultra-orca-boros-en-ja-v1 as calibration set

Tags

  • mistral
  • gptq
  • ja
  • en
  • 8-bit
  • compressed-tensors

Technical specifications

Parameters12B
LibraryNot available
Languagesja, en
Base modelcyberagent/Mistral-Nemo-Japanese-Instruct-2408
Licenseapache-2.0