Skip to content

vllm.models.step5.amd

Modules:

  • checks –

    Startup checks for the ROCm Step5 sparse attention layers.

  • csa_attention –

    Step-5 CSA as one graph-splitting custom op: region summaries, scoring,

  • csa_cache –

    Step-5 CSA region summaries as their own KV cache group, and the per-step

  • model –

    Step5 on ROCm: compressed sparse attention (CSA) and an FP32 residual.

  • mtp –

    Step5 MTP on ROCm.

  • ops –
  • vl –

    Inference-only Step5 vision-language model on ROCm.

  • warmup –