microsoft / MiniLM-L12-H384-uncased

Other43.3K126Updated May 19, 2021

Downloads

43.3K

Likes

126

Last updated

May 19, 2021

License

mit

MiniLM is a distilled model from the paper "MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers".

Tasks & library

  • text classification
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • jax
  • bert
  • text-classification

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
Licensemit