Skip to content

Supported Models

Get the latest info here: https://github.com/vllm-project/vllm-ascend/issues/1608

Legend Description:

  • ✅ = Supported model/feature
  • 🔵 = Experimental supported model/feature
  • ❌ = Not supported model/feature
  • 🟡 = Not tested or verified

Text-Only Language Models

Generative Models

Core Supported Models

Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Pipeline Parallel Expert Parallel Data Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len MLP Weight Prefetch Doc
DeepSeek V4-Flash ✅ Native mixed MXFP8/MXFP4 weights Ascend 950 Products ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1M DeepSeek V4-Flash
DeepSeek V4-Pro ✅ Native mixed MXFP8/MXFP4 weights Ascend 950 Products ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1M DeepSeek V4-Pro
DeepSeek-V3.1 ✅ ✅ Ascend 950 Products ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 240k DeepSeek-V3.1
GLM-5.1 ✅ ✅ Ascend 950 Products ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 200k GLM-5.1
Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Pipeline Parallel Expert Parallel Data Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len Doc
DeepSeek V4-Flash 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1M DeepSeek-V4-Flash
DeepSeek V4-Pro 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1M DeepSeek-V4-Pro
DeepSeek V3/3.1 ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 240k DeepSeek-V3.1
DeepSeek V3.2 ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 160k DeepSeek-V3.2
DeepSeek R1 ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 128k DeepSeek-R1
Qwen3-Dense ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 128k Qwen3-Dense
Qwen3-30B-A3B ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ Qwen3-30B-A3B
Qwen3-Coder-30B-A3B 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ Qwen3-Coder-30B-A3B
Qwen3-235B-A22B ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 256k Qwen3-235B-A22B
Qwen3-Next 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ Qwen3-Next
GLM-4.x ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 198k GLM-4.x
GLM-5/5.1 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 200k GLM-5
GLM-5.2 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 200k GLM-5.2
Gemma4 🔵 ✅ A2/A3/Ascend950 ✅ ✅ ✅ ✅ ✅ ✅ ✅ Gemma4
Kimi-K2-Thinking 🔵 A2/A3 Kimi-K2-Thinking
DeepSeekOCR2 ✅ ✅ A2/A3 ✅ ✅ DeepSeekOCR2
MiniMax-M2.5/2.7 🔵 ✅ A2/A3/Ascend950 (Ascend950 experimental) ✅ ✅ ✅ ❌ ✅ ✅ ✅ 🟡 ✅ ✅ ✅ 🟡 ✅ 200k MiniMax-M2
Qwen2.5-Math-RM-72B 🔵 vllm-rm, tensor_parallel_size=4, max_model_len=4096 ✅ A2 ✅ 🟡 🟡 ❌ 🟡 ✅ ✅ 🟡 🟡 🟡 🟡 🟡 🟡 4096 Qwen2.5-Math-RM-72B
Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len Doc
Qwen3-Dense ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ 🟡 ✅ ✅ ❌ ✅ ✅ 20k Qwen3-Dense
Qwen3-30B-A3B ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ 🟡 ✅ ✅ ❌ ✅ ✅ 16k Qwen3-30B-A3B

Extended Compatible Models

Model Support Note Supported Hardware
DeepSeek Distill (Qwen/Llama) 🔵 A2/A3
Qwen3-based 🔵 A2/A3
Qwen2 🔵 A2/A3
Qwen2.5 🔵 A2/A3
Qwen2-based 🔵 A2/A3
QwQ-32B 🔵 A2/A3
Llama⅔/3.⅓.2 🔵 A2/A3
InternLM 🔵 #1962 A2/A3
Baichuan 🔵 A2/A3
Baichuan2 🔵 A2/A3
Phi-4-mini 🔵 A2/A3
MiniCPM 🔵 A2/A3
MiniCPM3 🔵 A2/A3
Ernie4.5 🔵 A2/A3
Ernie4.5-Moe 🔵 A2/A3
Gemma-2 🔵 A2/A3
Gemma-3 🔵 A2/A3
Phi-¾ 🔵 A2/A3
Mistral/Mistral-Instruct 🔵 A2/A3
Hy3-preview 🔵 A3
DeepSeek V2.5 🟡 Need test
Mllama 🟡 Need test
MiniMax-Text 🟡 Need test

Pooling Models

Model Support Note Supported Hardware W8A8 Doc
Qwen3-Embedding 🔵 A2/A3 🟡 Qwen3-Embedding
Qwen3-VL-Embedding 🔵 A2/A3 🔵 Qwen3-VL-Embedding
Qwen3-Reranker 🔵 A2/A3 🟡 Qwen3-Reranker
Qwen3-VL-Reranker 🔵 A2/A3 🔵 Qwen3-VL-Reranker
Molmo 🔵 1942 A2/A3 🟡
XLM-RoBERTa-based 🔵 A2/A3 🟡
Bert 🔵 A2/A3 🟡
Qwen2.5-Math-RM-72B 🔵 Reward Model, gsm8k_correctness accuracy=0.80 A2 Qwen2.5-Math-RM-72B
Model Support Note Supported Hardware W8A8 Doc
Qwen3-Embedding 🔵 FP16 Atlas 300I DUO 🟡 Qwen3_Embedding
Qwen3-VL-Embedding 🔵 FP16 Atlas 300I DUO 🔵 Qwen3_VL_Embedding
Qwen3-Reranker 🔵 FP16 Atlas 300I DUO 🟡 Qwen3_Reranker
Qwen3-VL-Reranker 🔵 FP16 Atlas 300I DUO 🔵 Qwen3_VL_Reranker
XLM-RoBERTa-based 🔵 FP16; embedding and scoring Atlas 300I DUO 🟡
Qwen2.5-based 🔵 FP16 classification Atlas 300I DUO 🟡

Multimodal Language Models

Generative Models

Core Supported Models

Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Pipeline Parallel Expert Parallel Data Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len MLP Weight Prefetch Doc
Qwen3.5-397B-A17B ✅ ✅ Ascend 950DT ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1010000 Qwen3.5-397B-A17B
Qwen3.6-27B ✅ ✅ Ascend 950 Products ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 262144 Qwen3.5-27B / Qwen3.6-27B
Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Pipeline Parallel Expert Parallel Data Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len Doc
Qwen3-VL ✅ A2/A3 ✅ ✅ ✅ Qwen-VL-Dense
Qwen3-VL-30B-A3B/Qwen3-VL-235B-A22B ✅ ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 262144 Qwen3-VL-30B-A3B/Qwen3-VL-235B-A22B
Qwen3.5-397B-A17B 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 1010000 Qwen3.5-397B-A17B
Qwen3.5-27B / Qwen3.6-27B 🔵 ✅ A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 262144 Qwen3.5-27B / Qwen3.6-27B
Qwen3.6-35B-A3B 🔵 ✅ A2/A3 ✅ ✅ ✅ 🔵 ✅ ✅ ✅ ✅ ❌ ✅ ✅ 262144 Qwen3.6-35B-A3B
Qwen3-Omni-30B-A3B-Thinking 🔵 A2/A3 ✅ ✅ Qwen3-Omni-30B-A3B-Thinking
Kimi-K2.5/Kimi-K2.6 🔵 A2/A3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ 262144 Kimi-K2.5/Kimi-K2.6
MiniMax-M3 🔵 Text, image, video, and ViT DP ✅ A2/A3 ✅ ✅ ✅ ❌ ✅ ✅ ✅ ✅ ✅ ✅ ❌ ❌ ✅ 1M MiniMax-M3
Model Support Note BF16 Supported Hardware W8A8 Chunked Prefill Automatic Prefix Cache LoRA Speculative Decoding Async Scheduling Tensor Parallel Prefill-decode Disaggregation Piecewise AclGraph Fullgraph AclGraph max-model-len Doc
Qwen3-VL ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ 🟡 ✅ ✅ ❌ ✅ ✅ 16k Qwen-VL-Dense
Qwen3.5-Dense ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❌ ✅ ✅ 256k Qwen3.5-Dense
Qwen3.5-35B-A3B ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❌ ✅ ✅ 256k Qwen3.5-35B-A3B
Qwen3.6-27B ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❌ ✅ ✅ 256k Qwen3.6-27B
Qwen3.6-35B-A3B ✅ ❌ Atlas 300I DUO ✅ ✅ ✅ ❌ ✅ ✅ ✅ ❌ ✅ ✅ 256k Qwen3.6-35B-A3B
PaddleOCR-VL ✅ ❌ Atlas 300I DUO ❌ ✅ ✅ ❌ ❌ ✅ ❌ ❌ ✅ ✅ 16k PaddleOCR-VL
Qwen3-ASR ✅ ❌ Atlas 300I DUO ❌ ✅ ✅ ❌ ❌ ✅ 🟡 ❌ ✅ ✅ 4096 Qwen3-ASR-1.7B

Extended Compatible Models

Model Support Note Supported Hardware
Qwen2-VL 🔵 A2/A3
Qwen3-Omni 🔵 A2/A3
QVQ 🔵 A2/A3
Qwen2-Audio 🔵 A2/A3
Aria 🔵 A2/A3
LLaVA-Next 🔵 A2/A3
LLaVA-Next-Video 🔵 A2/A3
MiniCPM-V 🔵 A2/A3
Mistral3 🔵 A2/A3
Phi-3-Vision/Phi-3.5-Vision 🔵 A2/A3
Gemma3 🔵 A2/A3
Llama3.2 🔵 A2/A3
PaddleOCR-VL 🔵 A2/A3
Llama4 ❌ 1972
Keye-VL-8B-Preview ❌ 1961
Florence-2 ❌ 2259
GLM-4V ❌ 2260
InternVL2.0/2.5/3.0
InternVideo2.5/Mono-InternVL		 ❌ 2064
Whisper ❌ 2262
Ultravox 🟡 Need test