ISTA-DASLab / gemma-3-4b-it-GPTQ-4b-128g
Vision4.3B6447Updated Apr 13, 2025
Downloads
644
Likes
7
Last updated
Apr 13, 2025
License
gemma
This model was obtained by quantizing the weights of gemma-3-4b-it to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%.
Tasks & library
- image text to text
- transformers
Tags
- transformers
- gemma3
- image-text-to-text
- int4
- vllm
- llmcompressor
