vllm_omni.entrypoints.cli.benchmark.base ¶

OmniBenchmarkSubcommandBase ¶

Bases: CLISubcommand

The base class of subcommands for vllm bench.

help: str

add_cli_args(parser: ArgumentParser) -> None

Add the CLI arguments to the parser.

cmd(args: Namespace) -> None

Run the benchmark.

Parameters:

Name	Type	Description	Default
`args`	`Namespace`	The arguments to the command.	required