Skip to content

vLLM

vllm.entrypoints.cli

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.utils
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
  - distributed
  - engine
  - entrypoints
    entrypoints
    
    vllm.entrypoints
    
    vllm.entrypoints.api_server
    
    vllm.entrypoints.chat_utils
    
    vllm.entrypoints.launcher
    
    vllm.entrypoints.llm
    
    vllm.entrypoints.logger
    
    vllm.entrypoints.score_utils
    
    vllm.entrypoints.ssl
    
    vllm.entrypoints.utils
    
    cli
    cli
    
    vllm.entrypoints.cli vllm.entrypoints.cli
    Table of contents
    
    cli
    
    vllm.entrypoints.cli.collect_env
    
    vllm.entrypoints.cli.main
    
    vllm.entrypoints.cli.openai
    
    vllm.entrypoints.cli.run_batch
    
    vllm.entrypoints.cli.serve
    
    vllm.entrypoints.cli.types
    
    benchmark
    
    openai
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - v1
  - worker
CLI Reference
Community

Table of contents

cli

vllm.entrypoints.cli

Modules:

Name	Description
`benchmark`
`collect_env`
`main`
`openai`
`run_batch`
`serve`
`types`

Made with Material for MkDocs