Repository navigation
Commit 96d15b2
tests: start every process with one OpenBLAS thread
pyarrow imports numpy, and numpy's OpenBLAS starts one thread per core
at import and busy-waits them: 2.7 CPU-seconds per process on a 48-core
machine, for a suite that does no linear algebra. The conftest now sets
OPENBLAS_NUM_THREADS=1 (unless already set) before xdist starts its
workers, so every process of the session inherits it. On 48 cores the
full suite's CPU time fell from 363 s to 208 s.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>1 parent 847dce3 commit 96d15b2
1 file changed
Lines changed: 12 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
18 | 26 | | |
19 | 27 | | |
20 | 28 | | |
| |||
0 commit comments