RedHatAI / DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation16B25.4K14Updated Jul 18, 2024
Downloads
25.4K
Likes
14
Last updated
Jul 18, 2024
License
deepseek-license
Quantized version of DeepSeek-Coder-V2-Lite-Instruct. <!-- It achieves an average score of 73.19 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 73.48. -- It achieves an average score of 79.60 on the HumanEval+ benchmark, whereas the unquantized mo…
Tasks & library
- text generation
- transformers
Tags
- transformers
- deepseek_v2
- text-generation
- fp8
- vllm
- conversational
Technical specifications
Parameters16B
Librarytransformers
LanguagesNot available
Licensedeepseek-license
