Skip to content

vllm_omni.diffusion.executor.abstract

DiffusionExecutor

Bases: ABC

Abstract base class for Diffusion executors.

od_config instance-attribute

od_config = od_config

uses_multiproc class-attribute instance-attribute

uses_multiproc: bool = False

add_req abstractmethod

add_req(requests: OmniDiffusionRequest) -> DiffusionOutput

Add requests to the execution queue.

check_health abstractmethod

check_health() -> None

Check if the executor and workers are healthy.

collective_rpc abstractmethod

collective_rpc(
    method: str,
    timeout: float | None = None,
    args: tuple = (),
    kwargs: dict | None = None,
    unique_reply_rank: int | None = None,
    exec_all_ranks: bool = False,
) -> Any

Execute a method on workers.

execute_request abstractmethod

execute_request(
    scheduler_output: DiffusionSchedulerOutput,
) -> BaseRunnerOutput

Execute request-mode work from a scheduler output.

execute_step abstractmethod

execute_step(
    scheduler_output: DiffusionSchedulerOutput,
) -> BaseRunnerOutput

Execute step-mode work from a scheduler output.

get_class staticmethod

get_class(
    od_config: OmniDiffusionConfig,
) -> type[DiffusionExecutor]

register_failure_callback

register_failure_callback(
    callback: Callable[[], None],
) -> None

Register a callback invoked when the executor fatally fails.

Executors without a background failure monitor can keep the default no-op implementation.

shutdown abstractmethod

shutdown() -> None

Shutdown the executor and release resources.