Compatibility Matrix

The following table details the supported vLLM versions for Intel® Gaudi® 2 and Intel® Gaudi® 3 AI accelerators. The versions marked as unsupported may still work, but they have not been thoroughly tested. The latest validated release is vLLM v0.24.0 on Intel® Gaudi® software version 1.24.1.

vLLM version	Intel® Gaudi® software version
	1.22.1	1.22.2	1.23.0	1.24.0	1.24.1
0.10.1	✅ Beta	❌	❌	❌	❌
0.11.2	❌	✅	✅	❌	❌
0.13.0	❌	❌	✅	❌	❌
0.14.1	❌	❌	✅	❌	❌
0.15.1	❌	❌	✅	❌	❌
0.16.0	❌	❌	✅	❌	❌
0.17.1	❌	❌	✅	✅	❌
0.19.0	❌	❌	❌	✅	❌
0.19.1	❌	❌	❌	✅	❌
0.21.0	❌	❌	❌	✅	❌
0.24.0	❌	❌	❌	❌	✅