Skip to content

vllm_omni.diffusion.cache.teacache.state

TeaCache state management.

This module manages the state for TeaCache hooks across diffusion timesteps.

TeaCacheState

State management for TeaCache hook.

Tracks caching state across diffusion timesteps, managing counters, accumulated distances, and cached residuals for the TeaCache algorithm.

accumulated_rel_l1_distance instance-attribute 

accumulated_rel_l1_distance = 0.0

cnt instance-attribute 

cnt = 0

previous_modulated_input instance-attribute 

previous_modulated_input: Tensor | None = None

previous_residual instance-attribute 

previous_residual: Tensor | None = None

previous_residual_encoder instance-attribute 

previous_residual_encoder: Tensor | None = None

reset 

reset() -> None

Reset all state variables for a new inference run.