Skip to content

vllm_omni.host_weight_runtime.filesystem.writer

Store-scoped streaming safetensors publication.

ArtifactWriterError

Bases: RuntimeError

FilesystemArtifactWriter

Scoped writer that cannot publish outside one invisible staging dir.

staging_dir instance-attribute

staging_dir = staging_dir

abort

abort() -> None

finalize

open_tensor_file

open_tensor_file(
    relative_name: str,
    specs: tuple[TensorWriteSpec, ...],
    *,
    ordered: bool = False,
) -> StreamingSafeTensorFile

StreamingSafeTensorFile

One preallocated safetensors file filled through bounded CPU writes.

relative_name instance-attribute

relative_name = _safe_relative_name(relative_name)

specs instance-attribute

specs = tuple(sorted(specs, key=lambda spec: spec.name))

abort

abort() -> None

close

close() -> None

write_rows

write_rows(
    name: str, start_row: int, tensor: Tensor
) -> None

write_tensor

write_tensor(name: str, tensor: Tensor) -> None