vllm_omni.entrypoints.cli ¶

CLI helpers for vLLM-Omni entrypoints.

Modules:

Name	Description
`benchmark`
`logo`
`main`	CLI entry point for vLLM-Omni that intercepts vLLM commands.
`serve`	Omni serve command for vLLM-Omni.

OmniBenchmarkServingSubcommand ¶

The serve subcommand for vllm bench.

help = "Benchmark the online serving throughput. Supports Daily-Omni and Seed-TTS datasets."

name = 'serve'

add_cli_args(parser: ArgumentParser) -> None

cmd(args: Namespace) -> None

Bases: CLISubcommand

The serve subcommand for the vLLM CLI.

name = 'serve'

cmd(args: TrackingNamespace) -> None

subparser_init(
    subparsers: _SubParsersAction,
) -> TrackingArgumentParser

validate(args: Namespace) -> None