Skip to content

vllm.v1.worker.cpu.ec_connector

Classes:

  • ECConnector –

    EC connector interface used by the V2 CPU model runner.

ECConnector

EC connector interface used by the V2 CPU model runner.

Source code in vllm/v1/worker/cpu/ec_connector.py 
24
25
26
27
28
29
30
31
32
33
34
class ECConnector:
    """EC connector interface used by the V2 CPU model runner."""

    @contextmanager
    def maybe_get_output(
        self, scheduler_output: "SchedulerOutput"
    ) -> Generator[ECConnectorOutput | None, None, None]:
        yield None

    def no_forward(self, scheduler_output: "SchedulerOutput") -> ModelRunnerOutput:
        return EMPTY_MODEL_RUNNER_OUTPUT