hugpadhugpad

RedHatAI / DeepSeek-V2.5-1210-FP8

Text Generation236B20.9K4Updated Jan 4, 2025
Hugging Face

Downloads

20.9K

Likes

4

Last updated

Jan 4, 2025

License

deepseek

Quantized version of DeepSeek-V2.5-1210. It achieves an average score of 77.8 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 77.82.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • deepseek_v2
  • text-generation
  • moe
  • fp8
  • vllm

Technical specifications

Parameters236B
Librarytransformers
Languagesen
Licensedeepseek