kaitchup / Qwen3-VL-8B-Instruct-NVFP4
Other1.8B1311Updated Nov 5, 2025
Downloads
131
Likes
1
Last updated
Nov 5, 2025
License
apache-2.0
This is Qwen/Qwen3-VL-8B-Instruct quantized with AutoRound in NVFP4 (llm-compressor format). The model has been created, tested, and evaluated by The Kaitchup. The model is NOT compatible with vLLM (as of v0.11).
Tags
- qwen3_vl
- autoround
- nvfp4
- 4-bit
- auto-round
Technical specifications
Parameters1.8B
LibraryNot available
LanguagesNot available
Base modelQwen/Qwen3-VL-8B-Instruct
Licenseapache-2.0
