vllm_omni.diffusion.executor.abstract ¶
DiffusionExecutor ¶
Bases: ABC
Abstract base class for Diffusion executors.
add_req abstractmethod ¶
add_req(requests: OmniDiffusionRequest) -> DiffusionOutput
Add requests to the execution queue.
collective_rpc abstractmethod ¶
collective_rpc(
method: str,
timeout: float | None = None,
args: tuple = (),
kwargs: dict | None = None,
unique_reply_rank: int | None = None,
exec_all_ranks: bool = False,
) -> Any
Execute a method on workers.
execute_request abstractmethod ¶
execute_request(
scheduler_output: DiffusionSchedulerOutput,
) -> BaseRunnerOutput
Execute request-mode work from a scheduler output.
execute_step abstractmethod ¶
execute_step(
scheduler_output: DiffusionSchedulerOutput,
) -> BaseRunnerOutput
Execute step-mode work from a scheduler output.