Configuration Guide¶
This section provides a detailed configuration guide of vLLM Ascend.
See NPU Device Selection for --device-ids, its
interaction with ASCEND_RT_VISIBLE_DEVICES, and DP, PD, and Ray examples.
This section provides a detailed configuration guide of vLLM Ascend.
See NPU Device Selection for --device-ids, its
interaction with ASCEND_RT_VISIBLE_DEVICES, and DP, PD, and Ray examples.