Compatibility Matrix
The following table detail the supported vLLM versions for Intel® Gaudi® 2 and Intel® Gaudi® 3 AI accelerators. vLLM v0.10.0 and earlier versions are no longer supported and are therefore not listed in this table.
| Intel® Gaudi® Software | vLLM v0.10.1 | vLLM v0.11.2 | vLLM v0.13.0 |
|---|---|---|---|
| 1.22.1 | ✅ Beta | ❌ | ❌ |
| 1.22.2 | ❌ | ✅ | ❌ |
| 1.23.0 | ❌ | ✅ | ✅ |