Skip to content

DeepSeek V4 Flash

Quantization examples for the DeepSeek V4 Flash model.

DeepSeek V4 Flash uses a hybrid attention architecture with CSA, HCA, and mHC projections. The example below quantizes the MoE expert weights to NVFP4 while keeping the attention projections in FP8-Block.

Examples

Pre-quantized Checkpoints