Design Documents¶

This section contains design documents and architecture specifications for vLLM-Omni.

Architecture Documents¶

• Architecture Overview

Feature Design Documents¶

• Disaggregated Inference
• Ray-based Execution
• Adding Step Execution Support for Diffusion Pipelines
• Continuous Batching for Step-Wise Diffusion

Infrastructure Design Documents¶

• Prometheus Metrics

Module Design Documents¶

• AR Module
• DIT Module
• Entrypoint Module