Supported Models

Get the latest info here: vllm-project/vllm-ascend#1608

Legend Description:

• ✅ = Supported model/feature

• 🔵 = Experimental supported model/feature

• ❌ = Not supported model/feature

• 🟡 = Not tested or verified

Text-Only Language Models

Generative Models

Core Supported Models

Ascend 950 Products

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Pipeline Parallel	Expert Parallel	Data Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	MLP Weight Prefetch	Doc
DeepSeek V4-Flash	✅	Native mixed MXFP8/MXFP4 weights		Ascend 950 Products	✅	✅	✅		✅	✅		✅	✅	✅	✅		✅	1M		DeepSeek V4-Flash
DeepSeek V4-Pro	✅	Native mixed MXFP8/MXFP4 weights		Ascend 950 Products	✅	✅	✅		✅	✅		✅	✅	✅	✅		✅	1M		DeepSeek V4-Pro
DeepSeek-V3.1	✅		✅	Ascend 950 Products	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	240k		DeepSeek-V3.1
GLM-5.1	✅		✅	Ascend 950 Products	✅	✅	✅		✅	✅	✅		✅	✅	✅		✅	200k		GLM-5.1

A2/A3

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Pipeline Parallel	Expert Parallel	Data Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	MLP Weight Prefetch	Doc
DeepSeek V4-Flash	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅	✅		✅	1M		DeepSeek V4-Flash
DeepSeek V4-Pro	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅	✅		✅	1M		DeepSeek-V4-Pro
DeepSeek V3/3.1	✅		✅	A2/A3	✅	✅	✅		✅		✅	✅	✅	✅	✅	✅	✅	240k		DeepSeek-V3.1
DeepSeek V3.2	✅		✅	A2/A3	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	160k	✅	DeepSeek-V3.2
DeepSeek R1	✅		✅	A2/A3	✅	✅	✅		✅		✅	✅	✅	✅	✅	✅	✅	128k		DeepSeek-R1
Qwen3-Dense	✅		✅	A2/A3	✅	✅	✅			✅	✅			✅		✅	✅	128k	✅	Qwen3-Dense
Qwen3-30B-A3B	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅		✅	✅			Qwen3-30B-A3B
Qwen3-Coder-30B-A3B	🔵		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅		✅	✅			Qwen3-Coder-30B-A3B
Qwen3-235B-A22B	✅		✅	A2/A3	✅	✅	✅			✅	✅		✅	✅	✅	✅	✅	256k		Qwen3-235B-A22B
Qwen3-Next	🔵		✅	A2/A3	✅						✅			✅		✅	✅			Qwen3-Next
GLM-4.x	✅			A2/A3	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	198k		GLM-4.x
GLM-5/5.1	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅	✅	✅	✅	✅	✅	✅	200k		GLM-5
GLM-5.2	🔵		✅	A2/A3	✅	✅	✅		✅	✅	✅	✅	✅	✅	✅	✅	✅	200k		GLM-5
Kimi-K2-Thinking	🔵			A2/A3																Kimi-K2-Thinking
DeepSeekOCR2	✅		✅	A2/A3		✅				✅										DeepSeekOCR2
MiniMax-M2.5/2.7	✅		✅	A2/A3/Ascend950 (Ascend950 experimental)	✅	✅	✅	❌	✅	✅	✅	🟡	✅	✅	✅	🟡	✅	200k	🟡	MiniMax-M2
Qwen2.5-Math-RM-72B	🔵	vllm-rm, tensor_parallel_size=4, max_model_len=4096	✅	A2	✅	🟡	🟡	❌	🟡	✅	✅	🟡	🟡	🟡	🟡	🟡	🟡	4096	🟡	Qwen2.5-Math-RM-72B

Atlas 300I DUO

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	Doc
Qwen3-Dense	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	🟡	✅	✅	❌	✅	✅	20k	Qwen3-Dense
Qwen3-30B-A3B	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	🟡	✅	✅	❌	✅	✅	16k	Qwen3-30B-A3B

Extended Compatible Models

Model	Support	Note	Supported Hardware
DeepSeek Distill (Qwen/Llama)	🔵		A2/A3
Qwen3-based	🔵		A2/A3
Qwen2	🔵		A2/A3
Qwen2.5	✅		A2/A3
Qwen2-based	🔵		A2/A3
QwQ-32B	🔵		A2/A3
Llama2/3/3.1/3.2	🔵		A2/A3
Internlm	🔵	#1962	A2/A3
Baichuan	🔵		A2/A3
Baichuan2	🔵		A2/A3
Phi-4-mini	🔵		A2/A3
MiniCPM	🔵		A2/A3
MiniCPM3	🔵		A2/A3
Ernie4.5	🔵		A2/A3
Ernie4.5-Moe	🔵		A2/A3
Gemma-2	🔵		A2/A3
Gemma-3	🔵		A2/A3
Phi-3/4	🔵		A2/A3
Mistral/Mistral-Instruct	🔵		A2/A3
Hy3-preview	🔵		A3
DeepSeek V2.5	🟡	Need test
Mllama	🟡	Need test
MiniMax-Text	🟡	Need test

Pooling Models

A2/A3

Model	Support	Note	Supported Hardware	W8A8	Doc
Qwen3-Embedding	🔵		A2/A3	🟡	Qwen3-Embedding
Qwen3-VL-Embedding	🔵		A2/A3	🔵	Qwen3-VL-Embedding
Qwen3-Reranker	🔵		A2/A3	🟡	Qwen3-Reranker
Qwen3-VL-Reranker	🔵		A2/A3	🔵	Qwen3-VL-Reranker
Molmo	🔵	1942	A2/A3	🟡
XLM-RoBERTa-based	🔵		A2/A3	🟡
Bert	🔵		A2/A3	🟡
Qwen2.5-Math-RM-72B	🔵	Reward Model, gsm8k_correctness accuracy=0.80	A2	🟡	Qwen2.5-Math-RM-72B

Atlas 300I DUO

Model	Support	Note	Supported Hardware	W8A8	Doc
Qwen3-Embedding	🔵	FP16	Atlas 300I DUO	🟡	Qwen3-Embedding
Qwen3-VL-Embedding	🔵	FP16	Atlas 300I DUO	🔵	Qwen3-VL-Embedding
Qwen3-Reranker	🔵	FP16	Atlas 300I DUO	🟡	Qwen3-Reranker
Qwen3-VL-Reranker	🔵	FP16	Atlas 300I DUO	🔵	Qwen3-VL-Reranker
XLM-RoBERTa-based	🔵	FP16; embedding and scoring	Atlas 300I DUO	🟡
Qwen2.5-based	🔵	FP16 classification	Atlas 300I DUO	🟡

Multimodal Language Models

Generative Models

Core Supported Models

Ascend 950 Products

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Pipeline Parallel	Expert Parallel	Data Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	MLP Weight Prefetch	Doc
Qwen3.5-397B-A17B	✅		✅	Ascend 950DT	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	1010000		Qwen3.5-397B-A17B
Qwen3.6-27B	✅		✅	Ascend 950 Products	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	262144		Qwen3.5-27B / Qwen3.6-27B

A2/A3

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Pipeline Parallel	Expert Parallel	Data Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	MLP Weight Prefetch	Doc
Qwen3-VL	✅			A2/A3							✅					✅	✅			Qwen-VL-Dense
Qwen3-VL-30B-A3B/Qwen3-VL-235B-A22B	✅		✅	A2/A3	✅	✅	✅			✅	✅		✅	✅	✅	✅	✅	262144		Qwen3-VL-30B-A3B/Qwen3-VL-235B-A22B
Qwen3.5-397B-A17B	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	1010000		Qwen3.5-397B-A17B
Qwen3.5-27B / Qwen3.6-27B	✅		✅	A2/A3	✅	✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	262144		Qwen3.5-27B / Qwen3.6-27B
Qwen3.6-35B-A3B	✅		✅	A2/A3	✅	✅	✅		🔵	✅	✅		✅	✅	❌	✅	✅	262144		Qwen3.6-35B-A3B
Qwen3-Omni-30B-A3B-Thinking	✅			A2/A3							✅		✅							Qwen3-Omni-30B-A3B-Thinking
Kimi-K2.5/Kimi-K2.6	✅			A2/A3		✅	✅		✅	✅	✅		✅	✅	✅	✅	✅	262144		Kimi-K2.5/Kimi-K2.6

Atlas 300I DUO

Model	Support	Note	BF16	Supported Hardware	W8A8	Chunked Prefill	Automatic Prefix Cache	LoRA	Speculative Decoding	Async Scheduling	Tensor Parallel	Prefill-decode Disaggregation	Piecewise AclGraph	Fullgraph AclGraph	max-model-len	Doc
Qwen3-VL	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	🟡	✅	✅	❌	✅	✅	16k	Qwen-VL-Dense
Qwen3.5-Dense	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	✅	✅	✅	❌	✅	✅	256k	Qwen3.5-Dense
Qwen3.5-35B-A3B	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	✅	✅	✅	❌	✅	✅	256k	Qwen3.5-35B-A3B
Qwen3.6-27B	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	✅	✅	✅	❌	✅	✅	256k	Qwen3.6-27B
Qwen3.6-35B-A3B	✅		❌	Atlas 300I DUO	✅	✅	✅	❌	✅	✅	✅	❌	✅	✅	256k	Qwen3.6-35B-A3B
PaddleOCR-VL	🔵		❌	Atlas 300I DUO	❌	✅	✅	❌	❌	✅	❌	❌	✅	✅	16k	PaddleOCR-VL
Qwen3-ASR	🔵		❌	Atlas 300I DUO	❌	✅	✅	❌	❌	✅	🟡	❌	✅	✅	4096	Qwen3-ASR-1.7B

Extended Compatible Models

Model	Support	Note	Supported Hardware
Qwen2-VL	🔵		A2/A3
Qwen3-Omni	🔵		A2/A3
QVQ	🔵		A2/A3
Qwen2-Audio	🔵		A2/A3
Aria	🔵		A2/A3
LLaVA-Next	🔵		A2/A3
LLaVA-Next-Video	🔵		A2/A3
MiniCPM-V	🔵		A2/A3
Mistral3	🔵		A2/A3
Phi-3-Vision/Phi-3.5-Vision	🔵		A2/A3
Gemma3	🔵		A2/A3
Llama3.2	🔵		A2/A3
PaddleOCR-VL	🔵		A2/A3
Llama4	❌	1972
Keye-VL-8B-Preview	❌	1961
Florence-2	❌	2259
GLM-4V	❌	2260
InternVL2.0/2.5/3.0 InternVideo2.5/Mono-InternVL	❌	2064
Whisper	❌	2262
Ultravox	🟡	Need test