FINAL-Bench / VKORE-325M-NPU-Base
Text Generation326M1K39Updated Oct 26, 2026
Downloads
1K
Likes
39
Last updated
Oct 26, 2026
License
apache-2.0
The common wisdom was absolute: an inference only NPU cannot train. Not even LoRA fine tuning, let alone pretraining from scratch. First we proved it wrong at 46M. Now we did it at 325M, seven times larger, on 5 billion tokens of real web text, and matched a B200 GPU.
Tasks & library
- text generation
- transformers
Tags
- transformers
- llama
- text-generation
- npu
- npu-training
- npu-pretraining
Technical specifications
Parameters326M
Librarytransformers
Languagesen
Licenseapache-2.0
