Skip to content

feature_matrix

The table below shows mutually exclusive features and the support on Ascend hardware, extended from the vLLM table.

The symbols used have the following meanings:

  • ✅ = Full compatibility
  • 🟠 = Partial compatibility
  • ❌ = No compatibility
  • ❔ = Unknown or TBD
Feature ACLGraph Full_Decode_Only ACLGraph Piecewise Async Scheduling APC Chunked Prefill Decode Context Parallel CPU Binding DP Disaggregated Prefill Eagle3 EPLB EP KV Cache Pool Lmhead TP MLAPO mm Multistream MoE Shared Expert DP Quantization W4A4 Quantization W4A8 Quantization W8A8 TP Weight nz
ACLGraph Full_Decode_Only ✅
ACLGraph Piecewise ❌ ✅
Async Scheduling ✅ ✅ ✅
APC ✅ ✅ ✅ ✅
Chunked Prefill ✅ ✅ ✅ ✅ ✅
Decode Context Parallel ✅ ✅ ✅ ✅ ✅ ✅
CPU Binding ✅ ✅ ✅ ✅ ✅ ✅ ✅
DP ✅ ✅ ✅ ✅ ✅ 🟠1 ✅ ✅
Disaggregated Prefill ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Eagle3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
EPLB ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
EP ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
KV Cache Pool ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Lmhead TP ✅ ✅ ✅ ✅ ✅ ❔ ✅ 🟠2 ✅ ✅ ✅ ✅ ❔ ✅
MLAPO ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 🟠3 ✅ ✅ ✅ ❔ ✅ ✅
mm ✅ ✅ ✅ ✅ ✅ 🟠 ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅
Multistream MoE ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Shared Expert DP ✅ ✅ ✅ ✅ ✅ 🟠1 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔ ✅
Quantization W4A4 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ❔ ✅ ✅ ❔ ❌ ❔ ❔ ✅
Quantization W4A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❔ ❌ ✅ ✅ ❔ ✅
Quantization W8A8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅
TP ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Weight nz ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❌ 🟠 ✅ ✅ ✅
  • 1 Lmhead TP is only enabled in the pure dp scenarios.
  • 2 MLAPO is only supported on the decode stage.