Supported Models

Model	Supported	Note
DeepSeek v3	✅
DeepSeek R1	✅
DeepSeek Distill (Qwen/LLama)	✅
Qwen3	✅
Qwen3-Moe	✅
Qwen2-VL	✅
Qwen2-Audio	✅
Qwen2.5	✅
Qwen2.5-VL	✅
QwQ-32B	✅
MiniCPM	✅
LLama3.1/3.2	✅
Internlm	✅
InternVL2	✅
InternVL2.5	✅
Molomo	✅
LLaVA 1.5	✅
LLaVA 1.6	✅	#553
Baichuan	✅
Phi-4-mini	✅
Gemma-3	❌	#496
ChatGLM	❌	#554
LLama4	❌	#471
Mllama		Need test
LLaVA-Next		Need test
LLaVA-Next-Video		Need test
Phi-3-Vison/Phi-3.5-Vison		Need test
Ultravox		Need test
Mistral		Need test
DeepSeek v2.5		Need test
Gemma-2		Need test
GLM-4v		Need test