llmcompressor.pytorch.model_load.helpers
Functions:
-
get_session_model–:return: pytorch module stored by the active CompressionSession,
-
parse_dtype–:param dtype_arg: dtype or string to parse
get_session_model
Returns:
-
Optional[Module]–pytorch module stored by the active CompressionSession, or None if no session is active
Source code in src/llmcompressor/pytorch/model_load/helpers.py
parse_dtype
Parameters:
-
dtype_arg(Union[str, dtype]) –dtype or string to parse
Returns:
-
dtype–torch.dtype parsed from input string