Skip to content

vLLM-Omni

attention

Initializing search

vllm-project/vllm-omni

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM-Omni

vllm-project/vllm-omni

Home
User Guide
Developer Guide
API Reference
API Reference
- vllm_omni
  vllm_omni
  - data_entry_keys
  - logger
  - outputs
  - patch
  - request
  - version
  - attention
    
    attention
    
    fish_kvcache_attn
    
    fish_kvcache_backend
    
    fish_kvcache_triton
  - config
  - core
  - diffusion
  - distributed
  - engine
  - entrypoints
  - inputs
  - lora
  - metrics
  - model_executor
  - platforms
  - plugins
  - profiler
  - sample
  - tokenizers
  - transformers_utils
  - utils
  - worker
CLI Reference
Community

vllm_omni.attention ¶

Modules:

Name	Description
`fish_kvcache_attn`
`fish_kvcache_backend`
`fish_kvcache_triton`

Copyright © 2026 vLLM-Omni Team

Made with Material for MkDocs