baseten / DeepSeek-V3-FP4

This is the quantized version of the DeepSeek AI's DeepSeek-V3-0324 model, which quantized with TensorRT Model Optimizer.