vllm_omni.host_weight_runtime.filesystem.writer ¶
Store-scoped streaming safetensors publication.
ArtifactWriterError ¶
Bases: RuntimeError
FilesystemArtifactWriter ¶
Scoped writer that cannot publish outside one invisible staging dir.
finalize ¶
finalize(
identity: WeightArtifactIdentity,
metadata: ProductionMetadata,
) -> tuple[WeightManifest, PublicationMarker]
open_tensor_file ¶
open_tensor_file(
relative_name: str,
specs: tuple[TensorWriteSpec, ...],
*,
ordered: bool = False,
) -> StreamingSafeTensorFile
StreamingSafeTensorFile ¶
One preallocated safetensors file filled through bounded CPU writes.