Skip to content

vLLM Hardware Plugin for Intel® Gaudi®

layers

Initializing search

vLLM Hardware Plugin for Intel® Gaudi®

Getting Started
Getting Started
Configuration Guides
Configuration Guides
Features
Features
Design
Design
- Architecture Overview
Developer Guides
Developer Guides
API Reference
API Reference
- Summary
- Contents
  Contents
  - envs
  - vllm_gaudi
  - patches
  - platform
  - utils
  - attention
  - distributed
  - entrypoints
  - extension
  - lora
    lora
    
    lora
    
    layers
    layers
    
    layers
    
    hpu_row_parallel_linear
  - models
  - ops
  - v1
Troubleshooting
Frequently Asked Questions

vllm_gaudi.lora.layers ¶

Modules:

Name	Description
`hpu_row_parallel_linear`	HPU-specific LoRA layer for RowParallelLinear.

Made with Material for MkDocs