VAGOsolutions / SauerkrautLM-1.5b
Text Generation1.5B9710Updated Jun 13, 2024
Downloads
97
Likes
10
Last updated
Jun 13, 2024
License
apache-2.0
DEMO Model - to showcase the potential of resource-efficient Continuous Pre-Training of Large Language Models using Spectrum CPT
Tasks & library
- text generation
- transformers
Tags
- transformers
- qwen2
- text-generation
- spectrum
- continuous pretraining
- sft
Technical specifications
Parameters1.5B
Librarytransformers
Languagesde, en
Licenseapache-2.0