VAGOsolutions / SauerkrautLM-MoEdernColBERT-27M-GGUF
1261Updated Oct 23, 2026
Downloads
126
Likes
1
Last updated
Oct 23, 2026
License
apache-2.0
GGUF files of SauerkrautLM-MoEdernColBERT-27M for CPU inference with our small ggml-based engine. The 4-bit file is 18.9 MB and scores 0.6152 on NanoBEIR English (fp32: 0.6192).
Tasks & library
- sentence similarity
Tags
- gguf
- ColBERT
- late-interaction
- multi-vector
- mixture-of-experts
- moedernbert
Technical specifications
ParametersNot available
LibraryNot available
Languages7 languages
Licenseapache-2.0
