RedHatAI / DeepSeek-Coder-V2-Lite-Instruct-FP8

Text Generation16B25.4K14Updated Jul 18, 2024

Downloads

25.4K

Likes

14

Last updated

Jul 18, 2024

License

deepseek-license

Quantized version of DeepSeek-Coder-V2-Lite-Instruct. <!-- It achieves an average score of 73.19 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 73.48. -- It achieves an average score of 79.60 on the HumanEval+ benchmark, whereas the unquantized mo…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • deepseek_v2
  • text-generation
  • fp8
  • vllm
  • conversational

Technical specifications

Parameters16B
Librarytransformers
LanguagesNot available
Licensedeepseek-license