hugpadhugpad

meditsolutions / SmolLM2-MedIT-Upscale-2B

Other2.1B655Updated Dec 3, 2024
Hugging Face

Downloads

65

Likes

5

Last updated

Dec 3, 2024

License

apache-2.0

SmolLM2-MedIT-Upscale-2B is an expanded version of the SmolLM2-1.7B-Instruct model, increasing its parameter count to 2 billion. This expansion was achieved by doubling the number of heads in the qproj, kproj, vproj, and oproj layers, resulting in vectors of length 4096, compa…

Tags

  • llama
  • en
  • model-index

Technical specifications

Parameters2.1B
LibraryNot available
Languagesen
Base modelHuggingFaceTB/SmolLM2-1.7B-Instruct
Licenseapache-2.0