Compatibility Matrix
The following table detail the supported vLLM versions for Intel® Gaudi® 2 and Intel® Gaudi® 3 AI accelerators.
| Intel Gaudi Software | vLLM v0.10.1 | vLLM v0.11.2 | vLLM v0.13.0 | vLLM v0.14.1 | vLLM v0.15.1 | vLLM v0.16.0 |
|---|---|---|---|---|---|---|
| 1.22.1 | ✅ Beta | ❌ | ❌ | ❌ | ❌ | ❌ |
| 1.22.2 | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ |
| 1.23.0 | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ |