openaccess-ai-collective / llama-13b-alpaca-wizard-vicuna

Text Generation365Updated May 9, 2023

Downloads

36

Likes

5

Last updated

May 9, 2023

License

apache-2.0

- vicgalle/alpaca-gpt4 1 epoch, learning rate 3e-5 https://wandb.ai/wing-lian/wizard-vicuna-gpt4/overview - deepspeed scripts/finetune.py configs/axolotl/wizard-vicuna-13b-step1.yml --deepspeed configs/dsconfig.json --numepochs 2 --warmupsteps 46 --loggingsteps 1 --savesteps 2…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • en

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseapache-2.0