Skip to content

vLLM Hardware Plugin for Intel® Gaudi®

kv_offload

vLLM Hardware Plugin for Intel® Gaudi®

Getting Started
Getting Started
Configuration Guides
Configuration Guides
Features
Features
Design
Design
- Architecture Overview
Developer Guides
Developer Guides
API Reference
API Reference
- Summary
- Contents
  Contents
  - envs
  - vllm_gaudi
  - patches
  - platform
  - utils
  - attention
  - distributed
  - entrypoints
  - extension
  - lora
  - models
  - ops
  - v1
    v1
    
    v1
    
    attention
    
    engine
    
    kv_offload
    kv_offload
    
    kv_offload
    
    worker
    
    spec_decode
    
    worker
Troubleshooting
Frequently Asked Questions

vllm_gaudi.v1.kv_offload ¶

Modules:

Name	Description
`worker`