ISTA-DASLab / gemma-3-12b-it-GPTQ-4b-128g

This model was obtained by quantizing the weights of gemma-3-12b-it to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.