hugpadhugpad

chihoonlee10 / T3Q-LLM-MG-v1.0

Text Generation11B150Updated Apr 30, 2024
Hugging Face

Downloads

15

Likes

0

Last updated

Apr 30, 2024

License

apache-2.0

MODELDIR = "chihoonlee10/T3Q-LLM-MG-v1.0" model = AutoModelForCausalLM.frompretrained(MODELDIR, torchdtype=torch.float16).to("cuda") tokenizer = AutoTokenizer.frompretrained(MODELDIR) streamer = TextStreamer(tokenizer, skipprompt=True, skipspecialtokens=True)

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational

Technical specifications

Parameters11B
Librarytransformers
LanguagesNot available
Licenseapache-2.0