Repository navigation
Commit c80d906
authored
perf(ci): Cut Docker smoke-test time on large runners (#588)
## What
Two changes to the Docker smoke-test job:
- **Disk cleanup runs only when space is short.** Cleanup is skipped
when both `/` and Docker's storage filesystem have at least 30 GiB free.
Smaller runners still clean up as before.
- **The generic PDF and `.gz` format checks use the one-page PDF**
instead of the full paper. The `.gz` case compresses that PDF in
pytest's temp directory, so the unused `layout-parser-paper.pdf.gz`
fixture is removed.
```
Before: cleanup 183s (with 371 GiB free) · .pdf case 175s · .pdf.gz case 191s
After: cleanup skipped · both cases process a one-page PDF
```
## Why
These checks only confirm that each file type is accepted and parsed.
The full paper is still processed by the table-extraction, strategy, and
parallel-mode smoke tests, so the generic format cases don't need it.
All 37 cases and their explicit-MIME, inferred-MIME, and CSV assertions
remain.
## Validation
actionlint and Ruff pass, and all 37 smoke tests collect. Both changed
cases were run against a controlled response, and the gzip decompresses
byte-for-byte to the source PDF. Both disk branches (enough space and
low space) were tested with mocked commands. Full timing comes from this
PR's CI
([baseline](https://github.com/Unstructured-IO/unstructured-api/actions/runs/36955856924)).1 parent cba716b commit c80d906
3 files changed
Lines changed: 24 additions & 21 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
102 | 102 | | |
103 | 103 | | |
104 | 104 | | |
105 | | - | |
| 105 | + | |
106 | 106 | | |
107 | | - | |
108 | | - | |
109 | | - | |
110 | | - | |
111 | | - | |
112 | | - | |
113 | | - | |
114 | | - | |
115 | | - | |
116 | | - | |
117 | | - | |
118 | | - | |
119 | | - | |
120 | | - | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
121 | 120 | | |
122 | | - | |
123 | | - | |
124 | | - | |
| 121 | + | |
125 | 122 | | |
126 | 123 | | |
127 | 124 | | |
| |||
Binary file not shown.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
67 | 67 | | |
68 | 68 | | |
69 | 69 | | |
70 | | - | |
| 70 | + | |
71 | 71 | | |
72 | 72 | | |
73 | 73 | | |
| |||
89 | 89 | | |
90 | 90 | | |
91 | 91 | | |
92 | | - | |
| 92 | + | |
93 | 93 | | |
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
97 | | - | |
| 97 | + | |
98 | 98 | | |
99 | 99 | | |
100 | 100 | | |
| |||
113 | 113 | | |
114 | 114 | | |
115 | 115 | | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
116 | 122 | | |
117 | 123 | | |
118 | 124 | | |
| |||
0 commit comments