Repository navigation
Commit 7c4cae6
authored
Implement load_into for SharedPtrDataLoader (pytorch#22210)
### Summary
`SharedPtrDataLoader` never overrode `load_into`, so it fell back to the
stub in `runtime/core/data_loader.h` that logs an error and returns
`NotImplemented`. Anything loading through it fails as a result —
`Program::load_mutable_subsegment_into` and the training
`state_dict_util` being the ones that matter, so a mutable buffer with a
serialized initial value can't be read out of a shared buffer at all.
The other loaders all implement this; this one looks like it was just
missed.
Mirrors `BufferDataLoader::load_into`.
Fixes pytorch#11562
### Test plan
Added `InBoundsLoadIntoSucceeds` and `LoadIntoNullDstFails` to
`extension/data_loader/test/shared_ptr_data_loader_test.cpp`, matching
the `BufferDataLoader` equivalents. Ran the `SharedPtrDataLoaderTest`
suite locally, all 4 pass.
Authored with AI assistance (Claude Code).1 parent c6d0043 commit 7c4cae6
2 files changed
Lines changed: 77 additions & 0 deletions
File tree
- extension/data_loader
- test
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| |||
47 | 48 | | |
48 | 49 | | |
49 | 50 | | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
50 | 69 | | |
51 | 70 | | |
52 | 71 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
0 commit comments