Skip to content

vllm.triton_utils.tensor_descriptor

Functions:

use_tensor_descriptor(override=None)

Tri-state VLLM_TRITON_USE_TD: unset=auto (on for XPU), 1/0=force on/off.

Source code in vllm/triton_utils/tensor_descriptor.py 
 5
 6
 7
 8
 9
10
11
12
13
14
def use_tensor_descriptor(override: bool | None = None) -> bool:
    """Tri-state VLLM_TRITON_USE_TD: unset=auto (on for XPU), 1/0=force on/off."""
    from vllm import envs
    from vllm.platforms import current_platform

    if override is None:
        override = envs.VLLM_TRITON_USE_TD
    if override is not None:
        return override
    return current_platform.is_xpu()