jondurbin / mpt-30b-qlora-compatible

Text Generation10111Updated Jul 14, 2023

Downloads

101

Likes

11

Last updated

Jul 14, 2023

License

Not available

Slightly modified mpt-30b, which has some updates to allow gradient checkpointing/etc., to be compatible with qlora training code.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • mpt
  • text-generation
  • custom_code

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
LicenseNot available