hugpadhugpad

infly / OpenCoder-8B-Base

Text Generation7.8B10132Updated Nov 11, 2024
Hugging Face

Downloads

101

Likes

32

Last updated

Nov 11, 2024

License

inf

OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B base and chat models, supporting both English and Chinese languages. Starting from scratch, OpenCoder is pretrained on 2.5 trillion tokens composed of 90% raw code and 10% code-related web data, a…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • conversational
  • en

Technical specifications

Parameters7.8B
Librarytransformers
Languagesen, zh
Licenseinf