Skip to content

vllm_omni.worker.gpu_generation_worker ¶

logger `module-attribute` ¶

logger = init_logger(__name__)

GPUGenerationWorker ¶

Bases: OmniWorkerMixin, OmniGPUWorkerBase

GPU Worker for Generation model (non-autoregressive waveform generation).

Usage in stage config

worker_cls: "vllm_omni.worker.gpu_generation_model_runner.GPUGenerationModelRunner"

init_device ¶

init_device()