Installation

vLLM supports the following hardware platforms:

• GPU

  • NVIDIA CUDA

  • AMD ROCm

  • Intel XPU

• CPU

  • Intel/AMD x86

  • ARM AArch64

  • Apple silicon

  • IBM Z (S390X)

• Other AI accelerators

  • Google TPU

  • Intel Gaudi

  • AWS Neuron