inception42 / Jais-3-MoVA-36B-A4B

Jais-3-MoVA-36B-A4B is the sparse member of the Jais-3 family: a Mixture-of-Experts model with Mixture-of-Values attention (MoVA) that stores 36B parameters and runs 4B per token, with a 512K context window.