Skip to content

vllm_omni.plugins ¶

OMNI_DEFAULT_PLUGINS_GROUP `module-attribute` ¶

OMNI_DEFAULT_PLUGINS_GROUP = 'vllm_omni.general_plugins'

OMNI_PLATFORM_PLUGINS_GROUP `module-attribute` ¶

OMNI_PLATFORM_PLUGINS_GROUP = 'vllm_omni.platform_plugins'

logger `module-attribute` ¶

logger = getLogger(__name__)

omni_plugins_loaded `module-attribute` ¶

omni_plugins_loaded = False

load_omni_general_plugins ¶

load_omni_general_plugins() -> None

WARNING: plugins can be loaded for multiple times in different processes. They should be designed in a way that they can be loaded multiple times without causing issues.

load_omni_plugins_by_group ¶

load_omni_plugins_by_group(
    group: str,
) -> dict[str, Callable[[], Any]]