ruslanmv / granite-3.1-2b-Reasoning-GGUF

This is a GGUF quantized version of ruslanmv/granite-3.1-2b-Reasoning, fine-tuned from ibm-granite/granite-3.1-2b-instruct. The GGUF format allows for efficient inference on CPU and GPU, optimized for use with Kbit quantization levels (4-bit, 5-bit, and 8-bit).