amazon / GKA-primed-HQwen3-8B-Reasoner
Text Generation8.5B2395Updated Apr 3, 2026
Downloads
239
Likes
5
Last updated
Apr 3, 2026
License
apache-2.0
GKA-primed-HQwen3-8B-Reasoner is a Hybrid language model consisting of 50% Attention layers and 50% Gated KalmaNet (GKA) layers, primed from Qwen3-8B using the Hybrid Model Factory Priming pipeline. The model is trained for long-context reasoning and supports context lengths o…
Tasks & library
- text generation
- transformers
Tags
- transformers
- hybrid_qwen3
- text-generation
- hybrid
- ssm
- state-space-model