hugpadhugpad

allura-org / Rambley-150M-Base

Other150M331Updated Aug 10, 2026
Hugging Face

Downloads

33

Likes

1

Last updated

Aug 10, 2026

License

cc-by-sa-4.0

150M model with OLMo-3 style arch (with 2:1 SWA with a 512 token window), pretrained on ~150B tokens of Dolma 3 and further midtrained on ~25B tokens of the OLMo 3 midtraining mix. Compute sponsored by lium.io, thank you <3!

Tags

  • olmo3

Technical specifications

Parameters150M
LibraryNot available
LanguagesNot available
Base modelallura-org/Rambley-150M-RealBase
Licensecc-by-sa-4.0