JetBrains / Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M

Text Generation1.4K51Updated Jun 4, 2026

Downloads

1.4K

Likes

51

Last updated

Jun 4, 2026

License

apache-2.0

This repository contains a GGUF Q4KM quantization of JetBrains/Mellum2-12B-A2.5B-Thinking, ready to run with llama.cpp, Ollama, LM Studio, and other GGUF-compatible runtimes.

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • mellum
  • llama.cpp
  • quantized
  • moe
  • thinking

Technical specifications

ParametersNot available
Librarygguf
Languagesen
Licenseapache-2.0