hugpadhugpad

infly / OpenCoder-1.5B-Base

Text Generation1.9B32525Updated Nov 11, 2024
Hugging Face

Downloads

325

Likes

25

Last updated

Nov 11, 2024

License

inf

OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B base and chat models, supporting both English and Chinese languages. Starting from scratch, OpenCoder is pretrained on 2.5 trillion tokens composed of 90% raw code and 10% code-related web data, a…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • conversational
  • en

Technical specifications

Parameters1.9B
Librarytransformers
Languagesen, zh
Licenseinf