JetBrains / Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M
Text Generation1.4K51Updated Jun 4, 2026
Downloads
1.4K
Likes
51
Last updated
Jun 4, 2026
License
apache-2.0
This repository contains a GGUF Q4KM quantization of JetBrains/Mellum2-12B-A2.5B-Thinking, ready to run with llama.cpp, Ollama, LM Studio, and other GGUF-compatible runtimes.
Tasks & library
- text generation
- gguf
Tags
- gguf
- mellum
- llama.cpp
- quantized
- moe
- thinking
Technical specifications
ParametersNot available
Librarygguf
Languagesen
Base modelJetBrains/Mellum2-12B-A2.5B-Thinking
Licenseapache-2.0
