hugpadhugpad

RedHatAI / Meta-Llama-3.1-8B-Instruct-FP8

Text Generation8B47K45Updated Aug 19, 2026
Hugging Face

Downloads

47K

Likes

45

Last updated

Aug 19, 2026

License

llama3.1

Quantized version of Meta-Llama-3.1-8B-Instruct. It achieves an average score of 73.44 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 73.79.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • fp8
  • vllm
  • conversational

Technical specifications

Parameters8B
Librarytransformers
Languages8 languages
Base modelmeta-llama/Meta-Llama-3.1-8B-Instruct
Licensellama3.1