Skip to main content

Ctrl+K

Getting Started

Installation
Quickstart
Examples
Troubleshooting
Frequently Asked Questions
vLLM V1 User Guide

Models

Supported Models
Generative Models
Pooling Models
Built-in Extensions

Features

Quantization
Multimodal Inputs
Prompt Embedding Inputs
LoRA Adapters
Tool Calling
Reasoning Outputs
Structured Outputs
Automatic Prefix Caching
Disaggregated Prefilling (experimental)
Speculative Decoding
Compatibility Matrix

Training

Transformers Reinforcement Learning
Reinforcement Learning from Human Feedback

Inference and Serving

Offline Inference
OpenAI-Compatible Server
Server Arguments
Distributed Inference and Serving
Production Metrics
Engine Arguments
Environment Variables
Usage Stats Collection
External Integrations

Deployment

Security Guide
Using Docker
Using Kubernetes
Using Nginx
Using other frameworks
- Anything LLM
- BentoML
- Cerebrium
- Chatbox
- Dify
- dstack
- Helm
- LiteLLM
- Lobe Chat
- LWS
- Modal
- Open WebUI
- Retrieval-Augmented Generation
- SkyPilot
- Streamlit
- NVIDIA Triton
External Integrations

Performance

Optimization and Tuning
Benchmark Suites

Design Documents

Architecture Overview
Integration with HuggingFace
vLLM’s Plugin System
vLLM Paged Attention
Multi-Modal Data Processing
Automatic Prefix Caching
Python Multiprocessing

V1 Design Documents

vLLM’s torch.compile integration
Automatic Prefix Caching
Metrics

Developer Guide

Contributing to vLLM
Deprecation Policy
Profiling vLLM
Dockerfile
Adding a New Model
Vulnerability Management

API Reference

Summary
vllm

Community

vLLM Blog
vLLM Meetups
Sponsors

Repository
Suggest edit

.md

Using other frameworks

Using other frameworks#

Anything LLM
BentoML
Cerebrium
Chatbox
Dify
dstack
Helm
LiteLLM
Lobe Chat
LWS
Modal
Open WebUI
Retrieval-Augmented Generation
SkyPilot
Streamlit
NVIDIA Triton

previous

Using Nginx

next

Anything LLM

By the vLLM Team

© Copyright 2025, vLLM Team.