Skip to content

vLLM-Omni

Installation

Initializing search

vllm-project/vllm-omni

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM-Omni

vllm-project/vllm-omni

Home
User Guide
User Guide
- Getting Started
  Getting Started
  - Quickstart
  - GPU
  - NPU
- Serving
  Serving
  - OpenAI-Compatible API
- Examples
  Examples
  - Offline Inference
  - Online Serving
- General
  General
  - Frequently Asked Questions
  - Production Metrics
- Configuration
  Configuration
- Models
  Models
  - Supported Models
- Features
  Features
Developer Guide
API Reference
CLI Reference
Community

Installation¶

vLLM-Omni supports the following hardware platforms:

GPU
NPU

April 7, 2026

Copyright © 2026 vLLM-Omni Team

Made with Material for MkDocs