Design Documents

This section provides an overview of the features implemented in vLLM Ascend. Developers can refer to this guide to understand how vLLM Ascend works.

• KVPP: KV Cache Layer Parallelism — Physical cache placement, full-layer broadcast, and test design.