RedHatAI / Qwen3-30B-A3B-Instruct-2507-quantized.w4a16

This model was obtained by quantizing the weights of Qwen/Qwen3-30B-A3B-Instruct-2507 to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.