Skip to content

Configuration Guide

This section provides a detailed configuration guide of vLLM Ascend.

See NPU Device Selection for --device-ids, its interaction with ASCEND_RT_VISIBLE_DEVICES, and DP, PD, and Ray examples.