Repository navigation
Commit 74d024c
committed
[ET-VK][runtime][3/3] Enforce device-safe dispatch geometry
Pull Request resolved: pytorch#22225
Migrate dispatch, prepack, profiling, and workgroup picker interfaces to
`GlobalWorkGrid` and `LocalWorkGroup`. Wrap oversized linear grids using device
limits and validate final geometry before `vkCmdDispatch`.
Carry exact local geometry as `GlobalWorkGrid` metadata. Cooperative and
reduction grid pickers set it explicitly, while `pick_required_lwg` validates
and returns it. Preserve elongated Conv1d depthwise workgroups where the
default shape would regress GPU latency. Add end-to-end oversized linear
dispatch coverage.
Authored with Codex.
ghstack-source-id: 421281492
@exported-using-ghexport
Differential Revision: [D117706355](https://our.internmc.facebook.com/intern/diff/D117706355/)1 parent c99fcd4 commit 74d024c
110 files changed
Lines changed: 1500 additions & 1520 deletions
File tree
- backends/vulkan
- runtime
- api
- graph
- ops
- impl
- utils
- vk_api
- test
- custom_ops
- impl
- op_tests
- utils
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
76 | | - | |
77 | | - | |
| 76 | + | |
| 77 | + | |
78 | 78 | | |
79 | 79 | | |
80 | | - | |
81 | | - | |
82 | | - | |
83 | | - | |
84 | | - | |
85 | | - | |
| 80 | + | |
86 | 81 | | |
87 | 82 | | |
88 | 83 | | |
| |||
133 | 128 | | |
134 | 129 | | |
135 | 130 | | |
136 | | - | |
| 131 | + | |
137 | 132 | | |
138 | 133 | | |
139 | 134 | | |
| |||
142 | 137 | | |
143 | 138 | | |
144 | 139 | | |
145 | | - | |
146 | | - | |
147 | | - | |
148 | | - | |
| 140 | + | |
149 | 141 | | |
150 | 142 | | |
151 | 143 | | |
| |||
158 | 150 | | |
159 | 151 | | |
160 | 152 | | |
161 | | - | |
| 153 | + | |
162 | 154 | | |
163 | 155 | | |
164 | 156 | | |
| |||
168 | 160 | | |
169 | 161 | | |
170 | 162 | | |
171 | | - | |
| 163 | + | |
| 164 | + | |
172 | 165 | | |
173 | 166 | | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
174 | 178 | | |
175 | | - | |
176 | | - | |
177 | | - | |
178 | | - | |
179 | | - | |
180 | | - | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
181 | 182 | | |
182 | 183 | | |
183 | 184 | | |
184 | | - | |
185 | | - | |
186 | | - | |
187 | | - | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
188 | 189 | | |
189 | 190 | | |
190 | | - | |
191 | | - | |
192 | | - | |
193 | | - | |
194 | | - | |
| 191 | + | |
195 | 192 | | |
196 | 193 | | |
197 | 194 | | |
| |||
205 | 202 | | |
206 | 203 | | |
207 | 204 | | |
208 | | - | |
| 205 | + | |
209 | 206 | | |
210 | 207 | | |
211 | 208 | | |
| |||
324 | 321 | | |
325 | 322 | | |
326 | 323 | | |
327 | | - | |
328 | | - | |
329 | | - | |
330 | | - | |
331 | | - | |
| 324 | + | |
| 325 | + | |
332 | 326 | | |
333 | 327 | | |
334 | 328 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
151 | 151 | | |
152 | 152 | | |
153 | 153 | | |
154 | | - | |
155 | | - | |
| 154 | + | |
| 155 | + | |
156 | 156 | | |
157 | 157 | | |
158 | 158 | | |
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
200 | | - | |
201 | | - | |
| 200 | + | |
| 201 | + | |
202 | 202 | | |
203 | 203 | | |
204 | 204 | | |
205 | 205 | | |
206 | 206 | | |
207 | 207 | | |
208 | | - | |
| 208 | + | |
| 209 | + | |
209 | 210 | | |
210 | 211 | | |
211 | 212 | | |
| |||
220 | 221 | | |
221 | 222 | | |
222 | 223 | | |
223 | | - | |
224 | | - | |
| 224 | + | |
| 225 | + | |
225 | 226 | | |
226 | 227 | | |
227 | 228 | | |
| |||
334 | 335 | | |
335 | 336 | | |
336 | 337 | | |
337 | | - | |
338 | | - | |
| 338 | + | |
| 339 | + | |
339 | 340 | | |
340 | 341 | | |
341 | 342 | | |
| |||
368 | 369 | | |
369 | 370 | | |
370 | 371 | | |
| 372 | + | |
| 373 | + | |
| 374 | + | |
371 | 375 | | |
372 | | - | |
373 | | - | |
374 | | - | |
375 | | - | |
| 376 | + | |
376 | 377 | | |
377 | 378 | | |
378 | 379 | | |
379 | 380 | | |
380 | | - | |
381 | | - | |
382 | | - | |
383 | | - | |
384 | | - | |
| 381 | + | |
| 382 | + | |
385 | 383 | | |
386 | 384 | | |
387 | 385 | | |
| |||
390 | 388 | | |
391 | 389 | | |
392 | 390 | | |
393 | | - | |
| 391 | + | |
394 | 392 | | |
395 | 393 | | |
396 | 394 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
845 | 845 | | |
846 | 846 | | |
847 | 847 | | |
848 | | - | |
| 848 | + | |
849 | 849 | | |
850 | 850 | | |
851 | 851 | | |
| |||
857 | 857 | | |
858 | 858 | | |
859 | 859 | | |
860 | | - | |
861 | | - | |
862 | | - | |
863 | | - | |
| 860 | + | |
864 | 861 | | |
865 | 862 | | |
866 | 863 | | |
| |||
889 | 886 | | |
890 | 887 | | |
891 | 888 | | |
892 | | - | |
| 889 | + | |
893 | 890 | | |
894 | | - | |
| 891 | + | |
895 | 892 | | |
896 | | - | |
897 | | - | |
898 | 893 | | |
899 | | - | |
900 | | - | |
901 | | - | |
902 | | - | |
903 | | - | |
| 894 | + | |
| 895 | + | |
| 896 | + | |
904 | 897 | | |
905 | | - | |
906 | | - | |
907 | | - | |
908 | | - | |
909 | | - | |
| 898 | + | |
| 899 | + | |
| 900 | + | |
| 901 | + | |
| 902 | + | |
| 903 | + | |
| 904 | + | |
| 905 | + | |
| 906 | + | |
910 | 907 | | |
911 | | - | |
912 | | - | |
913 | | - | |
914 | | - | |
915 | | - | |
916 | | - | |
917 | | - | |
918 | | - | |
919 | | - | |
| 908 | + | |
| 909 | + | |
| 910 | + | |
920 | 911 | | |
921 | 912 | | |
922 | | - | |
923 | | - | |
924 | | - | |
925 | | - | |
926 | | - | |
927 | | - | |
| 913 | + | |
928 | 914 | | |
929 | | - | |
930 | | - | |
931 | | - | |
932 | | - | |
933 | | - | |
934 | | - | |
935 | | - | |
936 | | - | |
937 | | - | |
938 | | - | |
939 | | - | |
| 915 | + | |
| 916 | + | |
| 917 | + | |
| 918 | + | |
940 | 919 | | |
941 | 920 | | |
942 | | - | |
943 | | - | |
944 | | - | |
945 | | - | |
| 921 | + | |
| 922 | + | |
| 923 | + | |
| 924 | + | |
946 | 925 | | |
947 | 926 | | |
948 | | - | |
949 | | - | |
| 927 | + | |
| 928 | + | |
950 | 929 | | |
951 | 930 | | |
952 | 931 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1012 | 1012 | | |
1013 | 1013 | | |
1014 | 1014 | | |
1015 | | - | |
| 1015 | + | |
1016 | 1016 | | |
1017 | 1017 | | |
1018 | 1018 | | |
| |||
1025 | 1025 | | |
1026 | 1026 | | |
1027 | 1027 | | |
1028 | | - | |
1029 | | - | |
1030 | | - | |
| 1028 | + | |
| 1029 | + | |
1031 | 1030 | | |
1032 | 1031 | | |
1033 | 1032 | | |
1034 | 1033 | | |
1035 | | - | |
1036 | | - | |
1037 | | - | |
1038 | | - | |
| 1034 | + | |
| 1035 | + | |
1039 | 1036 | | |
1040 | | - | |
| 1037 | + | |
| 1038 | + | |
| 1039 | + | |
1041 | 1040 | | |
1042 | 1041 | | |
1043 | | - | |
| 1042 | + | |
1044 | 1043 | | |
1045 | 1044 | | |
1046 | 1045 | | |
1047 | 1046 | | |
1048 | | - | |
1049 | | - | |
| 1047 | + | |
| 1048 | + | |
1050 | 1049 | | |
1051 | | - | |
| 1050 | + | |
1052 | 1051 | | |
1053 | 1052 | | |
1054 | 1053 | | |
1055 | 1054 | | |
1056 | 1055 | | |
1057 | 1056 | | |
1058 | | - | |
| 1057 | + | |
1059 | 1058 | | |
1060 | 1059 | | |
1061 | 1060 | | |
| |||
0 commit comments