trillionlabs / Zoro

Zoro is a two-stream block-diffusion language model (research checkpoint). It is produced by continued SFT with the full-mask recipe — 100% of each block masked (single view, no complementary mask) at block size bd=8, fresh optimizer, LR 5e-5, ~2k steps — starting from the bas…