Skip to content
vLLM Hardware Plugin for Intel® Gaudi®
spec_decode
Initializing search
vLLM Hardware Plugin for Intel® Gaudi®
Getting Started
Getting Started
Overview
Quick Start
Installation
Release Notes
Compatibility Matrix
Validated Models
Configuration Guides
Configuration Guides
Environment Variables
Long Context Configuration
Calibration
Quantization and Inference
Performance Tuning
Warm-up
Features
Features
Supported Features
Bucketing Mechanism
Floating Point 8-bit
Warm-up
Row-Parallel Chunking
Design
Design
Architecture Overview
Developer Guides
Developer Guides
Plugin System
CI Failures
Profiling
API Reference
API Reference
Summary
Contents
Contents
envs
vllm_gaudi
patches
platform
utils
attention
distributed
entrypoints
extension
lora
models
ops
v1
v1
v1
attention
engine
kv_offload
spec_decode
spec_decode
spec_decode
hpu_eagle
worker
Troubleshooting
Frequently Asked Questions
vllm_gaudi.v1.spec_decode
¶
Modules:
Name
Description
hpu_eagle