JetBrains / Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0

Text Generation137.5K9Updated Jun 4, 2026

Downloads

137.5K

Likes

9

Last updated

Jun 4, 2026

License

apache-2.0

This repository contains a GGUF Q80 quantization of JetBrains/Mellum2-12B-A2.5B-Instruct, ready to run with llama.cpp, Ollama, LM Studio, and other GGUF-compatible runtimes.

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • mellum
  • llama.cpp
  • quantized
  • moe
  • instruct

Technical specifications

ParametersNot available
Librarygguf
Languagesen
Licenseapache-2.0