Skip to content

vllm.v1.worker.gpu.ec_connector

Classes:

  • ECConnector –

    EC connector interface used by the V2 GPU model runner.

ECConnector

EC connector interface used by the V2 GPU model runner.

Source code in vllm/v1/worker/gpu/ec_connector.py 
19
20
21
22
23
24
25
26
class ECConnector:
    """EC connector interface used by the V2 GPU model runner."""

    @contextmanager
    def maybe_get_output(
        self, scheduler_output: "SchedulerOutput"
    ) -> Generator[ECConnectorOutput | None, None, None]:
        yield None