vllm.model_executor.kernels.linear.mxfp8
¶
Modules:
-
Mxfp8LinearKernel– -
aiter_flydsl– -
b12x– -
deep_gemm– -
emulation– -
flashinfer– -
humming– -
marlin– -
pytorch– -
rocm_block32_gemm–MXFP8 GEMM on 32x32 block-scaled weights for gfx950 (
tl.dot_scaled). -
rocm_native–Native MXFP8 linear GEMM for AMD CDNA4 (gfx950) via Triton
tl.dot_scaled. -
xpu–
Classes:
-
Mxfp8LinearLayerConfig–Configuration for an MXFP8 linear layer.
Mxfp8LinearLayerConfig
dataclass
¶
Configuration for an MXFP8 linear layer.
All MXFP8 layers share the same structure: FP8-E4M3 weights with uint8 (E8M0) per-block scales at block size 32.
Attributes:
-
weight_shape(tuple[int, int]) –The layer's
(out_features, in_features), i.e.(N, K). -
activation_quant_key(QuantKey | None) –Requested activation format; None means weight-only.