Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.device_allocator

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.utils
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
    device_allocator
    
    vllm.device_allocator vllm.device_allocator
    Table of contents
    
    device_allocator
    
    vllm.device_allocator.cumem
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - v1
  - worker
CLI Reference
Community

Table of contents

device_allocator

vllm.device_allocator

Modules:

Name	Description
`cumem`

Made with Material for MkDocs