hugpadhugpad

KaLM-Embedding / KaLM-Reranker-V1-Nano-Q4_K_M-GGUF

Other271Updated Jul 7, 2026
Hugging Face

Downloads

27

Likes

1

Last updated

Jul 7, 2026

License

apache-2.0

[!IMPORTANT] This model requires the patched llama.cpp runtime bundled in llama.cpp/. Stock llama.cpp does not recognize the t5gemma2 architecture used here. Ollama, LM Studio, llama-server and other stock frontends are not supported by this release.

Tasks & library

  • text ranking
  • gguf

Tags

  • gguf
  • llama.cpp
  • reranker
  • encoder-decoder
  • t5gemma2
  • kalm-reranker

Technical specifications

ParametersNot available
Librarygguf
Languagesmultilingual
Base modelKaLM-Embedding/KaLM-Reranker-V1-Nano
Licenseapache-2.0