lightonai / ColBERT-Zero

Embeddings149M11.5K45Updated Aug 31, 2026

Downloads

11.5K

Likes

45

Last updated

Aug 31, 2026

License

apache-2.0

🎯 TL;DR: First large-scale fully pre-trained ColBERT model using only public data. Achieves 55.43 nDCG@10 on BEIR benchmark, outperforming GTE-ModernColBERT and GTE-ModernBERT trained on closed and stronger data. New SOTA on BEIR for models <150M parameters.

Tasks & library

  • sentence similarity
  • PyLate

Tags

  • PyLate
  • modernbert
  • ColBERT
  • multi-vector
  • sentence-transformers
  • sentence-similarity

Technical specifications

Parameters149M
LibraryPyLate
Languagesen
Licenseapache-2.0