Skip to content
vLLM Hardware Plugin for Intel® Gaudi®
lora
Initializing search
vLLM Hardware Plugin for Intel® Gaudi®
Getting Started
Getting Started
Overview
Quick Start
Installation
Release Notes
Compatibility Matrix
Validated Models
Configuration Guides
Configuration Guides
Environment Variables
Long Context Configuration
Calibration
Quantization and Inference
Performance Tuning
Warm-up
Features
Features
Supported Features
Bucketing Mechanism
Floating Point 8-bit
Warm-up
Row-Parallel Chunking
Design
Design
Architecture Overview
Developer Guides
Developer Guides
Plugin System
CI Failures
Profiling
API Reference
API Reference
Summary
Contents
Contents
envs
vllm_gaudi
patches
platform
utils
attention
distributed
entrypoints
extension
lora
lora
lora
layers
models
ops
v1
Troubleshooting
Frequently Asked Questions
vllm_gaudi.lora
¶
Modules:
Name
Description
layers