Alibaba-NLP / gte-en-mlm-large

Other435M3637Updated Aug 6, 2024

Downloads

363

Likes

7

Last updated

Aug 6, 2024

License

apache-2.0

We introduce GTE-v1.5 series, new generalized text encoder, embedding and reranking models that the context length of up to 8192. The models are built upon the transformer++ encoder backbone (BERT + RoPE + GLU, code refer to Alibaba-NLP/new-impl) as well as the vocabulary of b…

Tasks & library

  • fill mask

Tags

  • new
  • fill-mask
  • custom_code
  • en

Technical specifications

Parameters435M
LibraryNot available
Languagesen
Licenseapache-2.0