Skip to content

vllm_omni.entrypoints.cli.benchmark.base

Shared interface for vLLM-Omni benchmark CLI subcommands.

OmniBenchmarkSubcommandBase defines the argument-registration and command execution hooks required by benchmark implementations. The bench command discovers its concrete subclasses and uses these hooks to build and dispatch nested benchmark subcommands.

OmniBenchmarkSubcommandBase

Bases: CLISubcommand

The base class of subcommands for vllm bench.

help instance-attribute 

help: str

add_cli_args classmethod 

add_cli_args(parser: ArgumentParser) -> None

Add the CLI arguments to the parser.

cmd staticmethod 

cmd(args: Namespace) -> None

Run the benchmark.

Parameters:

Name Type Description Default
args Namespace

The arguments to the command.

 required