vllm_omni.entrypoints.pd_utils ¶
PD (Prefill-Decode) disaggregation helpers.
Mixin for OmniBase — keeps omni.py focused on orchestration.
PDDisaggregationMixin ¶
Mixin supplying PD disaggregation helpers to OmniBase.
detect_pd_separation_from_stage_configs staticmethod ¶
Scan stage configs for a prefill/decode pair.
Returns:
| Type | Description |
|---|---|
tuple[int, int] | None | (prefill_idx, decode_idx) if one pair exists, None if not found. |
Raises:
| Type | Description |
|---|---|
ValueError | if multiple candidate PD pairs are found. |