JetBrains / Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M

Text Generation85.9K20Updated Jun 4, 2026

Downloads

85.9K

Likes

20

Last updated

Jun 4, 2026

License

apache-2.0

This repository contains a GGUF Q4KM quantization of JetBrains/Mellum2-12B-A2.5B-Instruct, ready to run with llama.cpp, Ollama, LM Studio, and other GGUF-compatible runtimes.

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • mellum
  • llama.cpp
  • quantized
  • moe
  • instruct

Technical specifications

ParametersNot available
Librarygguf
Languagesen
Licenseapache-2.0