Repository navigation
Commit 2c36163
Vulkan: halve the pointwise conv spatial tile
conv2d_pw_tiled is generated only at TILE_M=4. TILE_M=2 is faster on every
model and both GPU vendors measured, and the tile size is otherwise
unchanged, so this just moves the generated variant.
Mali-G76 (Galaxy S10+), conv2d_pw / whole-graph GPU, median of interleaved
rounds: lraspp-mobilenet-v3-large fp16 @520 71.5 -> 43.8 ms (1.63x) and
99.3 -> 71.7 ms (1.38x); selfie-segmentation fp16 @256 4.21 -> 2.32 ms
(1.82x) and 8.46 -> 6.54 ms (1.29x).
Adreno 840 (Galaxy S26 Ultra): lraspp 5.35 -> 5.00 ms (1.07x) and
10.95 -> 10.59 ms (1.03x); selfie 0.530 -> 0.435 ms (1.22x) and
1.050 -> 0.956 ms (1.10x); PP-OCRv6 fp16 neutral at 1.00x / 0.99x.
Going the other way is much worse, which is what makes 2 the optimum
rather than a local accident: TILE_M=1 is 0.97x, TILE_M=8 0.24x,
TILE_N4=2 0.16x and TILE_N4=4 0.06x on Mali.
Output is bit identical at every tile size tested.1 parent 96051d4 commit 2c36163
2 files changed
Lines changed: 3 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
| 14 | + | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
79 | 79 | | |
80 | 80 | | |
81 | 81 | | |
82 | | - | |
83 | | - | |
| 82 | + | |
| 83 | + | |
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
| |||
0 commit comments