Skip to content

vllm.model_executor.model_loader.mtp_validation

Scoped controls for MTP checkpoint completeness validation.

Functions:

disable_mtp_completeness_check()

Temporarily disable MTP completeness validation for one weight load.

Source code in vllm/model_executor/model_loader/mtp_validation.py
@contextmanager
def disable_mtp_completeness_check() -> Iterator[None]:
    """Temporarily disable MTP completeness validation for one weight load."""
    token = _mtp_completeness_check_enabled.set(False)
    try:
        yield
    finally:
        _mtp_completeness_check_enabled.reset(token)

is_mtp_completeness_check_enabled()

Return whether MTP completeness validation is enabled in this scope.

Source code in vllm/model_executor/model_loader/mtp_validation.py
def is_mtp_completeness_check_enabled() -> bool:
    """Return whether MTP completeness validation is enabled in this scope."""
    return _mtp_completeness_check_enabled.get()