vllm_omni.entrypoints.api_server_shared_dir ¶

A scratch directory shared by the API processes of one multi-API server.

The multi-API launcher creates it before spawning the API processes, passes its path to them in their arguments, and removes it at shutdown. Frontend components that cooperate across API processes (for example the MOSS reference encoder) keep their files under it, so the sharing is scoped to one server's lifetime.

create_api_server_shared_dir ¶

create_api_server_shared_dir() -> str

Create the directory; the launcher passes its path to the API processes.

remove_api_server_shared_dir ¶

remove_api_server_shared_dir(path: str) -> None

Remove the directory once every API process has exited.