Skip to content

vllm_omni.entrypoints.pd_utils

PD (Prefill-Decode) disaggregation helpers.

Mixin for OmniBase — keeps omni.py focused on orchestration.

logger module-attribute

logger = getLogger(__name__)

PDDisaggregationMixin

Mixin supplying PD disaggregation helpers to OmniBase.

detect_pd_separation_from_stage_configs staticmethod

detect_pd_separation_from_stage_configs(
    stage_configs: list[Any],
) -> tuple[int, int] | None

Scan stage configs for a prefill/decode pair.

Returns:

Type Description
tuple[int, int] | None

(prefill_idx, decode_idx) if one pair exists, None if not found.

Raises:

Type Description
ValueError

if multiple candidate PD pairs are found.