incoai / GLM-5.3-NVFP4
Text Generation391B2.9K26Updated Aug 28, 2026
Downloads
2.9K
Likes
26
Last updated
Aug 28, 2026
License
glm-5.3
This repository contains an NVFP4-quantized version of Z.ai's zai-org/GLM-5.3. The weights and activations of the routed-expert linear layers are in NVFP4, and the KV cache is in FP8. The checkpoint uses the NVIDIA Model Optimizer format (quantmethod: modelopt) and is served d…
Tasks & library
- text generation
- transformers
Tags
- transformers
- glm_moe_dsa
- text-generation
- GLM-5
- ModelOpt
- quantized
