hugpadhugpad

Infermatic / Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic

Text Generation71B220Updated Oct 16, 2024
Hugging Face

Downloads

22

Likes

0

Last updated

Oct 16, 2024

License

llama3.1

Dynamic FP8 quant of Llama-3.1-Nemotron-70B-Instruct-HF made with AutoFP8.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • nvidia
  • llama3.1
  • conversational

Technical specifications

Parameters71B
Librarytransformers
Languagesen
Base modelmeta-llama/Llama-3.1-70B-Instruct
Licensellama3.1