dmis-lab / OSP-1.4B-1T-Muon-SSNorm-EmbProj

Quantization plays a crucial role in deploying Large Language Models (LLMs) in resource-constrained environments. However, the presence of outlier features significantly hinders low-bit quantization. While many studies address this problem in a post-hoc manner to make use of a…