vllm.distributed.ec_transfer.ec_connector.cpu ¶

Modules:

• common –

  Shared types for the ECCPUConnector scheduler and worker delegates.

• connector –

  ECCPUConnector — CPU encoder-cache offloading.

• ec_shared_region –

  Lightweight mmap-backed shared memory region for encoder cache (EC) data.

• scheduler –

  ECCPUScheduler — CPU offload scheduler delegate.

• worker –

  Worker-side of the ECCPUConnector.