Skip to content

vllm_omni.entrypoints.cli.benchmark.omni_duplex_eval

CLI for Omni-DuplexEval generate / evaluate / summarize.

generate still writes per-sample timed sentences and *.meta.json. Duplex performance metrics are written to <response-root>/duplex_metrics.json. Skipped samples keep previously recorded rows; incoming (split, sample_id) rows replace the matching ones, then duplex_stream_* is recomputed.

OmniDuplexEvalSubcommand

Bases: OmniBenchmarkSubcommandBase

Run the Omni-DuplexEval generation or scoring workflow.

help class-attribute instance-attribute

help = "Generate, evaluate, or summarize Omni-DuplexEval artifacts."

name class-attribute instance-attribute

name = 'omni-duplex-eval'

add_cli_args classmethod

add_cli_args(parser: ArgumentParser) -> None

cmd staticmethod

cmd(args: Namespace) -> None

add_cli_args

add_cli_args(parser: ArgumentParser) -> None

run

run(args: Namespace) -> int