Adding a New Model¶
This section provides comprehensive guidance on how to add a new model to vLLM-Omni.
Documentation¶
-
Adding an Omni-Modality Model: Complete step-by-step guide using Qwen3-Omni as an example.
-
Adding a Diffusion Model: Complete step-by-step guide using Qwen/Qwen-Image-Edit as an example.
-
Adding an RL Rollout Model: Developer guide for model-specific RL rollout parameter scopes, native weight reload, stage routing, and validation.
Quick Start¶
For a quick reference, see the Adding a New Multi-Stage Model Guide, Adding a New Diffusion Model Guide, and Adding an RL Rollout Model Guide.