Snowflake / Arctic-LSTM-Speculator-Llama-3.1-8B-Instruct

Other522Updated Sep 3, 2025

Downloads

52

Likes

2

Last updated

Sep 3, 2025

License

llama3.1

Build a fastest OSS vllm-based speculative decoding system for your own model, using ArcticTraining and ArcticInference!

Tags

  • pytorch
  • mlp_speculator

Technical specifications

ParametersNot available
LibraryNot available
LanguagesNot available
Licensellama3.1