Skip to content

vllm_omni.entrypoints.cli

CLI helpers for vLLM-Omni entrypoints.

Modules:

Name Description
benchmark
logo
main

CLI entry point for vLLM-Omni that intercepts vLLM commands.
serve

Omni serve command for vLLM-Omni.

OmniBenchmarkServingSubcommand

Bases: OmniBenchmarkSubcommandBase

The serve subcommand for vllm bench.

help class-attribute instance-attribute 

help = "Benchmark online serving. Supports Daily-Omni, OmniInteract, Omni-DuplexEval, and Seed-TTS datasets."

name class-attribute instance-attribute 

name = 'serve'

add_cli_args classmethod 

add_cli_args(parser: ArgumentParser) -> None

cmd staticmethod 

cmd(args: Namespace) -> None

OmniDuplexEvalSubcommand

Bases: OmniBenchmarkSubcommandBase

Run the Omni-DuplexEval generation or scoring workflow.

help class-attribute instance-attribute 

help = "Generate, evaluate, or summarize Omni-DuplexEval artifacts."

name class-attribute instance-attribute 

name = 'omni-duplex-eval'

add_cli_args classmethod 

add_cli_args(parser: ArgumentParser) -> None

cmd staticmethod 

cmd(args: Namespace) -> None

OmniServeCommand

Bases: CLISubcommand

The serve subcommand for the vLLM CLI.

name class-attribute instance-attribute 

name = 'serve'

cmd staticmethod 

cmd(args: TrackingNamespace) -> None

subparser_init 

subparser_init(
    subparsers: _SubParsersAction,
) -> FlexibleArgumentParser

validate 

validate(args: Namespace) -> None