Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.core

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.utils
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
    core
    
    vllm.core vllm.core
    Table of contents
    
    core
    
    vllm.core.block_manager
    
    vllm.core.evictor
    
    vllm.core.interfaces
    
    vllm.core.placeholder_block_space_manager
    
    vllm.core.scheduler
    
    block
  - device_allocator
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - v1
  - worker
CLI Reference
Community

Table of contents

core

vllm.core

Modules:

Name	Description
`block`
`block_manager`	A block manager that manages token blocks.
`evictor`
`interfaces`
`placeholder_block_space_manager`
`scheduler`

Made with Material for MkDocs