rinna / qwen2.5-bakeneko-32b

We conduct continual pre-training of Qwen/Qwen2.5-32B on 18B tokens from a mixture of Japanese and English datasets. The continual pre-training improves the model's performance on Japanese tasks.