Skip to content

vllm_omni.worker.scheduling_metadata_adapter

Runner-side adapters for payload metadata that affects scheduling.

logger module-attribute 

logger = init_logger(__name__)

DefaultSchedulingMetadataAdapter

Adapter for the established meta and codes.audio payload schema.

extract 

extract(
    payload: OmniPayload, *, model_mode: str
) -> SchedulingMetadataUpdate | None

SchedulingMetadataAdapter

Bases: Protocol

Translate runner payloads into generic scheduler-visible effects.

Configured adapters apply to runner-owned full-payload receive. Native MRV2 async receive uses the built-in adapter; other async-chunk paths remain owned by OmniChunkTransferAdapter.

Treat payload and all nested values, including tensors, as read-only. They may share storage with the runner's cached payload. Extraction must not modify them, including when it raises, so failed receives can be retried.

extract 

extract(
    payload: OmniPayload, *, model_mode: str
) -> SchedulingMetadataUpdate | None

resolve_scheduling_metadata_adapter 

resolve_scheduling_metadata_adapter(
    adapter: str | SchedulingMetadataAdapter | None,
) -> SchedulingMetadataAdapter

Resolve a configured adapter without exposing payload keys to schedulers.