trollek / NinjaMouse-3B-40L-danube

I have dun goofed and not tested the base model enough (and possibly goofed in other ways too), but I'm already training the new one based on h2oai/h2o-danube2-1.8b-chat. Perhaps S² attn or RoPE scaling will work and make a hella big context window possible? We'll see.