Skip to content
vLLM Hardware Plugin for Intel® Gaudi®
kv_connector
Initializing search
vLLM Hardware Plugin for Intel® Gaudi®
Getting Started
Getting Started
Overview
Quick Start
Installation
Release Notes
Compatibility Matrix
Validated Models
Configuration Guides
Configuration Guides
Environment Variables
Long Context Configuration
Calibration
Quantization and Inference
Performance Tuning
Warm-up
Features
Features
Supported Features
Bucketing Mechanism
Floating Point 8-bit
Warm-up
Developer Guides
Developer Guides
Plugin System
CI Failures
Profiling
API Reference
API Reference
Summary
Contents
Contents
envs
vllm_gaudi
platform
utils
attention
distributed
distributed
distributed
device_communicators
kv_transfer
kv_transfer
kv_transfer
kv_connector
kv_connector
kv_connector
v1
extension
models
ops
v1
Troubleshooting
Frequently Asked Questions
vllm_gaudi.distributed.kv_transfer.kv_connector
¶
Modules:
Name
Description
v1