Repository navigation
Commit e37af23
authored
Avoid nested thread-pool locking in
Summary:
Using Kleidi can invoke `parallel_for` inside an existing pool task. Calculating the inner chunk size queries the pool's thread count and relocks the mutex held by the outer call, hanging real model inference even with one thread.
Honor `NoThreadPoolGuard` before querying the pool. Run nested nonempty ranges directly and preserve the outer thread number used for per-thread scratch storage. Cover nested work, thread-number preservation, and empty ranges in both source mirrors.
AI-assisted: Codex.
Reviewed By: digantdesai
Differential Revision: D119433132
Pull Request resolved: pytorch#22663parallel_for (pytorch#22663)1 parent d2f2f5f commit e37af23
2 files changed
Lines changed: 33 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
70 | 70 | | |
71 | 71 | | |
72 | 72 | | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
73 | 98 | | |
74 | 99 | | |
75 | 100 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| 14 | + | |
14 | 15 | | |
15 | 16 | | |
16 | 17 | | |
| |||
61 | 62 | | |
62 | 63 | | |
63 | 64 | | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
64 | 72 | | |
65 | 73 | | |
66 | 74 | | |
| |||
0 commit comments