Skip to content

vllm_omni.platforms.xpu

Modules:

Name Description
platform
profiler
utils
worker

XPUOmniPlatform

Bases: OmniPlatform, XPUPlatform

XPU/Intel GPU implementation of OmniPlatform.

Inherits all XPU-specific implementations from vLLM's XPUPlatform, and adds Omni-specific interfaces from OmniPlatform.

get_default_ir_op_priority classmethod 

get_default_ir_op_priority(
    vllm_config: VllmConfig,
) -> IrOpPriorityConfig

Copied from upstream XPUPlatform with inductor-aware logic.

When inductor is active (compiling) use native as the default; otherwise prefer xpu_kernels where available.

get_default_stage_config_path classmethod 

get_default_stage_config_path() -> str

get_device_count classmethod 

get_device_count() -> int

get_device_memory classmethod 

get_device_memory(
    device: device | None = None,
) -> tuple[int, int]

get_device_version classmethod 

get_device_version() -> str | None

get_diffusion_attn_backend_cls classmethod 

get_diffusion_attn_backend_cls(
    selected_backend: str | None, head_size: int
) -> str

get_free_memory classmethod 

get_free_memory(device: device | None = None) -> int

get_omni_ar_worker_cls classmethod 

get_omni_ar_worker_cls() -> str

get_omni_generation_worker_cls classmethod 

get_omni_generation_worker_cls() -> str

get_profiler_cls classmethod 

get_profiler_cls() -> str

Return XPU-specific profiler that handles XPU events.

get_torch_device classmethod 

get_torch_device(local_rank: int | None = None) -> device

supports_torch_inductor classmethod 

supports_torch_inductor() -> bool

synchronize classmethod 

synchronize() -> None