Skip to content

vLLM Hardware Plugin for Intel® Gaudi®

bucketing

Initializing search

vLLM Hardware Plugin for Intel® Gaudi®

Getting Started
Getting Started
Configuration Guides
Configuration Guides
Features
Features
Developer Guides
Developer Guides
API Reference
API Reference
- Summary
- Contents
  Contents
  - envs
  - vllm_gaudi
  - platform
  - utils
  - attention
  - distributed
  - extension
    extension
    
    extension
    
    cache_ops
    
    config
    
    debug
    
    defragmentation
    
    environment
    
    features
    
    kernels
    
    logger
    
    ops
    
    profiler
    
    runtime
    
    scales
    
    unified
    
    unified_batch
    
    utils
    
    validation
    
    bucketing
    bucketing
    
    bucketing
    
    common
    
    exponential
    
    file_strategy
    
    linear
    
    unified
    
    vision
  - models
  - ops
  - v1
Troubleshooting
Frequently Asked Questions

vllm_gaudi.extension.bucketing ¶

Modules:

Name	Description
`common`
`exponential`
`file_strategy`
`linear`
`unified`
`vision`

Made with Material for MkDocs