hugpadhugpad

vicgalle / gpt-j-6B-alpaca-gpt4

Text Generation13020Updated Apr 9, 2023
Hugging Face

Downloads

130

Likes

20

Last updated

Apr 9, 2023

License

mit

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • gptj
  • text-generation
  • gpt-j
  • instruction-tuning

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licensemit