vllm.model_executor.model_loader.weight_cache.weight_seed.seed
¶
The weights seedable: a daemon both serves and fetches its shard.
Classes:
-
WeightShardSeed–This daemon's weight shard: served to and fetched from peer daemons.
WeightShardSeed
¶
Bases: Seedable
This daemon's weight shard: served to and fetched from peer daemons.
Methods:
-
release–Wait for copies, then drop source state without blocking their acks.
-
request_params–Ask this daemon's source for the shard, over the fitting mover.
-
resolve–Describe this rank so a peer daemon can mirror it.
-
validate_payload–Structural checks plus the shard fingerprint against this daemon.
-
validate_remote–Refuse node-local movers on the remote control plane.
Source code in vllm/model_executor/model_loader/weight_cache/weight_seed/seed.py
38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 | |
release()
¶
Wait for copies, then drop source state without blocking their acks.
Source code in vllm/model_executor/model_loader/weight_cache/weight_seed/seed.py
request_params(ctx)
¶
Ask this daemon's source for the shard, over the fitting mover.
Source code in vllm/model_executor/model_loader/weight_cache/weight_seed/seed.py
resolve(request)
¶
Describe this rank so a peer daemon can mirror it.
Source code in vllm/model_executor/model_loader/weight_cache/weight_seed/seed.py
validate_payload(payload)
¶
Structural checks plus the shard fingerprint against this daemon.
Source code in vllm/model_executor/model_loader/weight_cache/weight_seed/seed.py
validate_remote(request)
¶
Refuse node-local movers on the remote control plane.