ISTA-DASLab / Llama-3.1-8B-Instruct-MatGPTQ

This is the official MatGPTQ checkpoint of meta-llama/Llama-3.1-8B-Instruct, produced as described in the "MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models" paper.