vllm_omni.entrypoints.cli.benchmark.serve ¶

OmniBenchmarkServingSubcommand ¶

The serve subcommand for vllm bench.

help = "Benchmark the online serving throughput. Supports Daily-Omni and Seed-TTS datasets."

name = 'serve'

add_cli_args(parser: ArgumentParser) -> None

cmd(args: Namespace) -> None

add_daily_omni_cli_args(parser: ArgumentParser) -> None

Add CLI arguments specific to Daily-Omni dataset.

This function should be called by the CLI entrypoint to add additional arguments for daily-omni benchmark support.

Parameters:

Name	Type	Description	Default
`parser`	`ArgumentParser`	The ArgumentParser instance to extend	required

add_omni_benchmark_cli_args(parser: ArgumentParser) -> None

Add vLLM-Omni specific serving benchmark options.

add_seed_tts_cli_args(parser: ArgumentParser) -> None

CLI for Seed-TTS zero-shot TTS benchmark (--dataset-name seed-tts).