hugpadhugpad

nisten / meta-405b-instruct-cpu-optimized-gguf

Other19740Updated Jul 24, 2024
Hugging Face

Downloads

197

Likes

40

Last updated

Jul 24, 2024

License

Not available

This repository contains CPU-optimized GGUF quantizations of the Meta-Llama-3.1-405B-Instruct model. These quantizations are designed to run efficiently on CPU hardware while maintaining good performance.

Tags

  • gguf
  • imatrix
  • conversational

Technical specifications

ParametersNot available
LibraryNot available
LanguagesNot available
Base modelmeta-llama/Meta-Llama-3.1-405B-Instruct
LicenseNot available