Skip to main content

Ctrl+K

Getting Started

Installation
Minimal Example
Troubleshooting

Tutorials

Disaggregated Prefill
KV Cache Offloading
KV Cache Aware Routing
Prefix Aware Routing

Deployment

Helm Charts
CRD Deployment
Cloud Environments
Ray Deployment

User Manual

Router Configuration
- JSON based configuration
- Command Line based configuration
LORA Configuration
- Manually Load LORA
KV Cache Offloading

Developer Guide

Peripheral
- Observability Models
- Interfaces
Developer API

Benchmarks

Multi-round QA

Repository
Suggest edit

.rst

Router Configuration

Router Configuration#

Test text

User Manual

JSON based configuration
Command Line based configuration

previous

Ray Deployment

next

JSON based configuration

By vLLM Production Stack Team

© Copyright 2025, vLLM Production Stack Team.