FINAL-Bench / VKORE-325M-NPU-Base

Text Generation326M1K39Updated Oct 26, 2026

Downloads

1K

Likes

39

Last updated

Oct 26, 2026

License

apache-2.0

The common wisdom was absolute: an inference only NPU cannot train. Not even LoRA fine tuning, let alone pretraining from scratch. First we proved it wrong at 46M. Now we did it at 325M, seven times larger, on 5 billion tokens of real web text, and matched a B200 GPU.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • npu
  • npu-training
  • npu-pretraining

Technical specifications

Parameters326M
Librarytransformers
Languagesen
Licenseapache-2.0