vllm.device_allocator ¶

Modules:

• alloc_conf –

  Helpers for reading and editing PyTorch's allocator configuration.

• cumem –
• sleep_mode_backend –

  Pluggable sleep-mode backends (RFC #34303).

• xpumem –