ruslanmv / granite-3.1-8b-Reasoning-GGUF

This is a GGUF quantized version of ruslanmv/granite-3.1-8b-Reasoning, fine-tuned from ibm-granite/granite-3.1-8b-instruct. The GGUF format enables efficient inference on CPUs and GPUs, optimized for various K-bit quantization levels (4-bit, 5-bit, and 8-bit).