hugpadhugpad

Snowflake / Llama-3.1-SwiftKV-405B-Instruct-FP8

Other425B480Updated Aug 13, 2025
Hugging Face

Downloads

48

Likes

0

Last updated

Aug 13, 2025

License

llama3.1

The Snowflake AI Research team is releasing a series of SwiftKV optimized Llama-3.1 models. SwiftKV is a series of inference optimizations that goes beyond traditional key-value (KV) cache compression. This method reduces computational overhead during prompt processing by comb…

Tags

  • llama_swiftkv
  • compressed-tensors

Technical specifications

Parameters425B
LibraryNot available
LanguagesNot available
Base modelmeta-llama/Llama-3.1-405B-Instruct
Licensellama3.1