hugpadhugpad

RedHatAI / Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation8B20.1K30Updated Jul 10, 2026
Hugging Face

Downloads

20.1K

Likes

30

Last updated

Jul 10, 2026

License

llama3.1

This model is a quantized version of Meta-Llama-3.1-8B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model, including multiple-choice, math reasoning, and open-ended text generation. Meta-Llama-3.1-8B-Instruct-quantized…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • facebook
  • meta
  • llama-3

Technical specifications

Parameters8B
Librarytransformers
Languages8 languages
Base modelmeta-llama/Llama-3.1-8B-Instruct
Licensellama3.1