Compatibility Matrix

The following table details the supported vLLM versions for Intel® Gaudi® 2 and Intel® Gaudi® 3 AI accelerators. The versions marked as unsupported may still work, but they have not been thoroughly tested.

vLLM version	Intel Gaudi software version
vLLM version	1.22.1	1.22.2	1.23.0	1.24.0
0.10.1	✅ Beta	❌	❌	❌
0.11.2	❌	✅	✅	❌
0.13.0	❌	❌	✅	❌
0.14.1	❌	❌	✅	❌
0.15.1	❌	❌	✅	❌
0.16.0	❌	❌	✅	❌
0.17.1	❌	❌	✅	✅
0.19.0	❌	❌	❌	✅
0.19.1	❌	❌	❌	✅