lightonai / ColBERT-Zero
149M11.5K45Updated Aug 31, 2026
Downloads
11.5K
Likes
45
Last updated
Aug 31, 2026
License
apache-2.0
π― TL;DR: First large-scale fully pre-trained ColBERT model using only public data. Achieves 55.43 nDCG@10 on BEIR benchmark, outperforming GTE-ModernColBERT and GTE-ModernBERT trained on closed and stronger data. New SOTA on BEIR for models <150M parameters.
Tasks & library
- sentence similarity
- PyLate
Tags
- PyLate
- modernbert
- ColBERT
- multi-vector
- sentence-transformers
- sentence-similarity
Technical specifications
Parameters149M
LibraryPyLate
Languagesen
Licenseapache-2.0
