Skip to content

vllm_omni.diffusion.cache.stepcache.config

Configuration for step-level DiT velocity caching.

STEP_CACHE_CONFIG_ATTR module-attribute

STEP_CACHE_CONFIG_ATTR = '_stepcache_config'

STEP_CACHE_STATE_ATTR module-attribute

STEP_CACHE_STATE_ATTR = '_stepcache_state'

StepCacheConfig dataclass

Runtime config for velocity-based step skipping.

Skips entire DiT forwards when successive video velocity predictions are highly aligned (cosine similarity above configured thresholds).

Reference: DreamZero paper DiT Caching / dreamzero.git should_run_model.

enabled class-attribute instance-attribute

enabled: bool = True

max_history class-attribute instance-attribute

max_history: int = 2

min_history_steps class-attribute instance-attribute

min_history_steps: int = 2

sim_thresholds class-attribute instance-attribute

sim_thresholds: tuple[float, ...] = (0.95, 0.93)

skip_countdowns class-attribute instance-attribute

skip_countdowns: tuple[int, ...] = (4, 2)

from_diffusion_cache_config classmethod

from_diffusion_cache_config(
    config: DiffusionCacheConfig,
) -> StepCacheConfig