hugpadhugpad

kaitchup / Qwen3.5-9B-autoround-W4A16

Other3.5B1613Updated Mar 3, 2026
Hugging Face

Downloads

161

Likes

3

Last updated

Mar 3, 2026

License

apache-2.0

This is Qwen/Qwen3.5-9B quantized with AutoRound to W4A16 (INT). The model is compatible with vLLM (tested: v0.16.1rc1). Tested with an H200. Currently under evaluation.

Tags

  • qwen3_5
  • autoround
  • 4-bit
  • auto-round

Technical specifications

Parameters3.5B
LibraryNot available
LanguagesNot available
Base modelQwen/Qwen3.5-9B
Licenseapache-2.0