distilbert / distilbert-base-cased

Other66M300.1K71Updated May 6, 2024

Downloads

300.1K

Likes

71

Last updated

May 6, 2024

License

apache-2.0

This model is a distilled version of the BERT base model. It was introduced in this paper. The code for the distillation process can be found here. This model is cased: it does make a difference between english and English.

Tasks & library

  • fill mask
  • transformers

Tags

  • transformers
  • pytorch
  • tf
  • onnx
  • distilbert
  • fill-mask

Technical specifications

Parameters66M
Librarytransformers
Languagesen
Licenseapache-2.0