Alibaba-NLP / gte-en-mlm-base

Other137M4038Updated Aug 6, 2024

Downloads

403

Likes

8

Last updated

Aug 6, 2024

License

apache-2.0

We introduce GTE-v1.5 series, new generalized text encoder, embedding and reranking models that the context length of up to 8192. The models are built upon the transformer++ encoder backbone (BERT + RoPE + GLU, code refer to Alibaba-NLP/new-impl) as well as the vocabulary of b…

Tasks & library

  • fill mask

Tags

  • new
  • fill-mask
  • custom_code
  • en

Technical specifications

Parameters137M
LibraryNot available
Languagesen
Licenseapache-2.0