vLLM-Omni entrypoints module.
Modules:
| Name | Description |
|---|---|
async_omni | AsyncOmni - Refactored async orchestrator using AsyncOmniEngine. |
chat_utils | |
cli | CLI helpers for vLLM-Omni entrypoints. |
client_request_state | |
omni | |
omni_base | |
openai | OpenAI-compatible API entrypoints for vLLM-Omni. |
openpi | |
pd_utils | PD (Prefill-Decode) disaggregation helpers. |
stage_utils | |
utils | |