vllm.entrypoints.openai ¶
Modules:
-
api_server– -
chat_completion– -
completion– -
models– -
parser– -
responses– -
sse_keep_alive–SSE keep-alive comments for idle streaming responses.
vllm.entrypoints.openai ¶Modules:
api_server – chat_completion – completion – models – parser – responses – sse_keep_alive – SSE keep-alive comments for idle streaming responses.