Kwaipilot / KwaiCoder-DS-V2-Lite-Base

Text Generation16B1707Updated Jan 6, 2025

Downloads

170

Likes

7

Last updated

Jan 6, 2025

License

mit

Kwai-Coder-DS-V2-Lite-Base is built on Deepseek-v2-Lite-Base, which has a total of 16B parameters and 2.4B activated parameters. It supports both English and Chinese and underwent continue pretraining on 800B tokens of high-quality code, math, and Chinese-English text data. Th…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • deepseek_v2
  • text-generation
  • code-generation
  • conversational

Technical specifications

Parameters16B
Librarytransformers
Languagesmultilingual
Licensemit