ZeusLabs / Chronos-Divergence-33B

The original model, LLaMA 1 was pre-trained at a sequence length of 2048 tokens. We went through two individual runs, targeting a sequence length of 16,384 which is a significant increase over the original length. While it was originally pre-trained on 1.4T tokens, it was show…