Skip to content

Commit 157b689

Browse files
committed
evidence(stage1): both campaigns re-recorded, and "both streams" now has two graves
p022-stage1-1 ubuntu, local 21/21 caught, 0 survived, 0 compile-error, 0 invalid, 0 runner-error p022-stage1-windows windows-latest 9/9 caught, same Both at source commit da897b4 with dirty:false, every expected catcher hit, and M00 surviving the unmutated tree on each. Nothing is added across those rows: they are different measurements on different platforms, and a mutant evaluated where its contract cannot be posed proves nothing about the surface it edits. The Windows record is the PUSH run's, not the pull_request run's. Both were 9/9, but the PR-triggered job checks out GitHub's synthetic merge commit and recorded `106973f375ce` — a commit that exists in no branch. Provenance that names a tree nobody can check out is not provenance, whatever its counts say. The two catchers this round exists for, from the Windows log: P03 -> ps1::ps1-agreement-replays stdout replay, stderr left intact P08 -> ps1::ps1-agreement-replays stderr replay alone, stdout intact Same catcher, different graves, and that is the whole point: measured separately before either was recorded, P03 dies on stdout in both fixtures with the stderr assertion silent, and P08 dies only on stderr against a launcher that emitted nothing there. Before this round one mutation broke both streams at once and the stdout assertion killed it on its own, so "both streams" was a sentence rather than a measurement. P09 -> ps1::ps1-absolute-locator the locator preflight keeps its POSITION P09 leaves every previously asserted observable correct — exit 2, the absolute requirement named, no verdict — and is caught only by the extraction counter this round added to the PowerShell surface. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CYLNQy6tLXqsV1CbuNqsSb
1 parent da897b4 commit 157b689

3 files changed

Lines changed: 56 additions & 45 deletions

File tree

‎docs/evidence/p022-stage1-1.result.json‎

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -4,9 +4,9 @@
44
"campaign": "p022-stage1-1",
55
"definition": "docs/evidence/p022-stage1-1.json",
66
"definition_sha256": "c8bd2180f285a130dfadc153e966e48b2c2d8d6072d90651906112719c0040eb",
7-
"source_commit": "1d649e99d9c9a8fac0913ac59fcbda94499479bb",
7+
"source_commit": "da897b42fcd76ea1914d286bd6bae6065c072c70",
88
"dirty": false,
9-
"recorded_at": "2026-09-09T07:11:44Z",
9+
"recorded_at": "2026-09-09T08:36:00Z",
1010
"layers": [
1111
"stage1"
1212
],
@@ -15,7 +15,7 @@
1515
"id": "M00",
1616
"outcome": "survived",
1717
"catchers": [],
18-
"elapsed_seconds": 27.8
18+
"elapsed_seconds": 34.4
1919
},
2020
"mutations": [
2121
{
@@ -24,15 +24,15 @@
2424
"catchers": [
2525
"stage1::default-stays-python"
2626
],
27-
"elapsed_seconds": 24.1
27+
"elapsed_seconds": 27.6
2828
},
2929
{
3030
"id": "M02",
3131
"outcome": "caught",
3232
"catchers": [
3333
"stage1::rust-actually-runs-rust"
3434
],
35-
"elapsed_seconds": 22.5
35+
"elapsed_seconds": 25.5
3636
},
3737
{
3838
"id": "M03",
@@ -41,7 +41,7 @@
4141
"stage1::rc70-is-not-a-verdict",
4242
"stage1::rust-failure-no-fallback"
4343
],
44-
"elapsed_seconds": 23.5
44+
"elapsed_seconds": 27.3
4545
},
4646
{
4747
"id": "M04",
@@ -52,15 +52,15 @@
5252
"stage1::rust-failure-no-fallback",
5353
"stage1::unexpected-rc-maps-to-5"
5454
],
55-
"elapsed_seconds": 23.6
55+
"elapsed_seconds": 27.1
5656
},
5757
{
5858
"id": "M05",
5959
"outcome": "caught",
6060
"catchers": [
6161
"stage1::raw-rc-retained"
6262
],
63-
"elapsed_seconds": 23.5
63+
"elapsed_seconds": 27.7
6464
},
6565
{
6666
"id": "M06",
@@ -69,7 +69,7 @@
6969
"stage1::absolute-locator-only",
7070
"stage1::bad-locator-is-2"
7171
],
72-
"elapsed_seconds": 23.8
72+
"elapsed_seconds": 26.9
7373
},
7474
{
7575
"id": "M07",
@@ -78,15 +78,15 @@
7878
"stage1::absolute-locator-only",
7979
"stage1::bad-locator-is-2"
8080
],
81-
"elapsed_seconds": 23.5
81+
"elapsed_seconds": 27.1
8282
},
8383
{
8484
"id": "M08",
8585
"outcome": "caught",
8686
"catchers": [
8787
"stage1::rust-failure-no-fallback"
8888
],
89-
"elapsed_seconds": 23.4
89+
"elapsed_seconds": 26.7
9090
},
9191
{
9292
"id": "M09",
@@ -95,7 +95,7 @@
9595
"stage1::absolute-locator-only",
9696
"stage1::bad-locator-is-2"
9797
],
98-
"elapsed_seconds": 23.3
98+
"elapsed_seconds": 27.4
9999
},
100100
{
101101
"id": "M10",
@@ -105,7 +105,7 @@
105105
"stage1::compare-same-input",
106106
"stage1::divergence-is-5"
107107
],
108-
"elapsed_seconds": 23.4
108+
"elapsed_seconds": 25.8
109109
},
110110
{
111111
"id": "M11",
@@ -114,23 +114,23 @@
114114
"stage1::compare-failure-classified",
115115
"stage1::exec-failure-is-5"
116116
],
117-
"elapsed_seconds": 22.9
117+
"elapsed_seconds": 26.2
118118
},
119119
{
120120
"id": "M12",
121121
"outcome": "caught",
122122
"catchers": [
123123
"stage1::compare-zero-document"
124124
],
125-
"elapsed_seconds": 22.9
125+
"elapsed_seconds": 26.9
126126
},
127127
{
128128
"id": "M13",
129129
"outcome": "caught",
130130
"catchers": [
131131
"stage1::candidate-identity"
132132
],
133-
"elapsed_seconds": 22.8
133+
"elapsed_seconds": 26.7
134134
},
135135
{
136136
"id": "M14",
@@ -139,23 +139,23 @@
139139
"stage1::compare-no-substitution",
140140
"stage1::divergence-is-5"
141141
],
142-
"elapsed_seconds": 22.6
142+
"elapsed_seconds": 25.9
143143
},
144144
{
145145
"id": "M15",
146146
"outcome": "caught",
147147
"catchers": [
148148
"stage1::divergence-is-5"
149149
],
150-
"elapsed_seconds": 23.6
150+
"elapsed_seconds": 26.7
151151
},
152152
{
153153
"id": "M16",
154154
"outcome": "caught",
155155
"catchers": [
156156
"stage1::compare-zero-document"
157157
],
158-
"elapsed_seconds": 23.6
158+
"elapsed_seconds": 26.1
159159
},
160160
{
161161
"id": "M17",
@@ -164,7 +164,7 @@
164164
"stage1::absolute-locator-only",
165165
"stage1::locator-shapes"
166166
],
167-
"elapsed_seconds": 25.5
167+
"elapsed_seconds": 28.7
168168
},
169169
{
170170
"id": "M18",
@@ -173,15 +173,15 @@
173173
"stage1::absolute-locator-only",
174174
"stage1::locator-shapes"
175175
],
176-
"elapsed_seconds": 28.4
176+
"elapsed_seconds": 31.0
177177
},
178178
{
179179
"id": "M19",
180180
"outcome": "caught",
181181
"catchers": [
182182
"stage1::compare-failure-classified"
183183
],
184-
"elapsed_seconds": 23.3
184+
"elapsed_seconds": 26.5
185185
},
186186
{
187187
"id": "M20",
@@ -195,7 +195,7 @@
195195
"stage1::locator-shapes",
196196
"stage1::rust-failure-no-fallback"
197197
],
198-
"elapsed_seconds": 11.5
198+
"elapsed_seconds": 13.0
199199
},
200200
{
201201
"id": "M21",
@@ -215,7 +215,7 @@
215215
"stage1::rust-failure-no-fallback",
216216
"stage1::unexpected-rc-maps-to-5"
217217
],
218-
"elapsed_seconds": 15.5
218+
"elapsed_seconds": 17.2
219219
}
220220
]
221221
}

‎docs/evidence/p022-stage1-windows.result.json‎

Lines changed: 27 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -3,10 +3,10 @@
33
"comment": "Recorded mutation-campaign run (scripts/mutate_campaign.py --run). Raw facts only: outcomes, catchers, provenance. Counts are derived by scripts/render_checkpoint_status.py; regenerate this file by re-running the campaign, never by hand.",
44
"campaign": "p022-stage1-windows",
55
"definition": "docs/evidence/p022-stage1-windows.json",
6-
"definition_sha256": "79ad1476f219239ecd4753d08dd8fd3ca018e17f35da368ba464196d1428aca0",
7-
"source_commit": "1d649e99d9c9a8fac0913ac59fcbda94499479bb",
6+
"definition_sha256": "6dbfa6054f6447bb41886b30b1b1ade3dcb9e1be0fb874dc5795b7775c30ebc3",
7+
"source_commit": "da897b42fcd76ea1914d286bd6bae6065c072c70",
88
"dirty": false,
9-
"recorded_at": "2026-09-09T07:09:15Z",
9+
"recorded_at": "2026-09-09T08:33:54Z",
1010
"layers": [
1111
"ps1",
1212
"shapes"
@@ -16,7 +16,7 @@
1616
"id": "M00",
1717
"outcome": "survived",
1818
"catchers": [],
19-
"elapsed_seconds": 66.6
19+
"elapsed_seconds": 58.9
2020
},
2121
"mutations": [
2222
{
@@ -25,39 +25,39 @@
2525
"catchers": [
2626
"ps1::ps1-absolute-locator"
2727
],
28-
"elapsed_seconds": 34.4
28+
"elapsed_seconds": 36.4
2929
},
3030
{
3131
"id": "P02",
3232
"outcome": "caught",
3333
"catchers": [
3434
"ps1::ps1-not-started-is-2"
3535
],
36-
"elapsed_seconds": 26.4
36+
"elapsed_seconds": 28.8
3737
},
3838
{
3939
"id": "P03",
4040
"outcome": "caught",
4141
"catchers": [
4242
"ps1::ps1-agreement-replays"
4343
],
44-
"elapsed_seconds": 24.1
44+
"elapsed_seconds": 31.6
4545
},
4646
{
4747
"id": "P04",
4848
"outcome": "caught",
4949
"catchers": [
5050
"ps1::ps1-failure-evidence"
5151
],
52-
"elapsed_seconds": 24.9
52+
"elapsed_seconds": 32.7
5353
},
5454
{
5555
"id": "P05",
5656
"outcome": "caught",
5757
"catchers": [
5858
"shapes::locator-shapes"
5959
],
60-
"elapsed_seconds": 24.2
60+
"elapsed_seconds": 31.1
6161
},
6262
{
6363
"id": "P06",
@@ -68,15 +68,31 @@
6868
"ps1::ps1-failure-evidence",
6969
"ps1::ps1-not-started-is-2"
7070
],
71-
"elapsed_seconds": 17.0
71+
"elapsed_seconds": 18.5
7272
},
7373
{
7474
"id": "P07",
7575
"outcome": "caught",
7676
"catchers": [
7777
"ps1::ps1-not-started-is-2"
7878
],
79-
"elapsed_seconds": 22.6
79+
"elapsed_seconds": 29.5
80+
},
81+
{
82+
"id": "P08",
83+
"outcome": "caught",
84+
"catchers": [
85+
"ps1::ps1-agreement-replays"
86+
],
87+
"elapsed_seconds": 28.8
88+
},
89+
{
90+
"id": "P09",
91+
"outcome": "caught",
92+
"catchers": [
93+
"ps1::ps1-absolute-locator"
94+
],
95+
"elapsed_seconds": 58.2
8096
}
8197
]
8298
}

‎docs/generated/p022-stage1-mutations.md‎

Lines changed: 5 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ Definition: `docs/evidence/p022-stage1-1.json` (sha256 `c8bd2180f285a130…`, 21
1212

1313
| measure | value |
1414
|--------------------------------------------------|---|
15-
| recorded at commit | `1d649e99d9c9a8fac0913ac59fcbda94499479bb` |
15+
| recorded at commit | `da897b42fcd76ea1914d286bd6bae6065c072c70` |
1616
| layers run (every one, for every mutation) | `stage1` |
1717
| mutations | 21 |
1818
| caught | 21 |
@@ -55,22 +55,17 @@ Definition: `docs/evidence/p022-stage1-windows.json` (sha256 `6dbfa6054f6447bb
5555

5656
| measure | value |
5757
|--------------------------------------------------|---|
58-
| recorded at commit | `1d649e99d9c9a8fac0913ac59fcbda94499479bb` |
58+
| recorded at commit | `da897b42fcd76ea1914d286bd6bae6065c072c70` |
5959
| layers run (every one, for every mutation) | `ps1`, `shapes` |
6060
| mutations | 9 |
61-
| caught | 7 |
61+
| caught | 9 |
6262
| survived | 0 |
6363
| compile-error (no evidence either way) | 0 |
6464
| invalid-mutation | 0 |
6565
| runner-error | 0 |
6666
| caught without every expected catcher | none |
6767
| honesty control `M00` (unmutated tree must pass) | survived — as required |
6868

69-
**This run is not evidence:**
70-
71-
- the recorded result was taken over a different campaign definition (sha256 or campaign name differs) — re-run the campaign
72-
- result/definition mutation sets differ (missing ['P08', 'P09'], unknown [])
73-
7469
| id | rule | mutation | outcome | caught by |
7570
|---|---|---|---|---|
7671
| P01 | ps1-locator-must-be-absolute | own-check.ps1 accepts a relative OWEN_RUST_CORE — Test-Path says the file is there, which is true and not the question D3 asks | caught | `ps1::ps1-absolute-locator` |
@@ -80,5 +75,5 @@ Definition: `docs/evidence/p022-stage1-windows.json` (sha256 `6dbfa6054f6447bb
8075
| P05 | absolute-locator-is-accepted | the shell's drive-rooted arm stops matching — this is the defect that actually shipped: `[/\]` escapes the closing bracket, so the set is unterminated and matches NEITHER `C:/` nor `C:\`, and every correct Windows locator was refused as 'not absolute' while every Linux control stayed green | caught | `shapes::locator-shapes` |
8176
| P06 | absolute-locator-is-accepted | own-check.ps1's absoluteness test is inverted — the over-rejection direction on this surface: every fully qualified locator is refused as 'not absolute' and every relative one is admitted, which no assertion that only feeds it a relative path can see | caught | `ps1::ps1-absolute-locator`<br>`ps1::ps1-agreement-replays`<br>`ps1::ps1-failure-evidence`<br>`ps1::ps1-not-started-is-2` |
8277
| P07 | the-candidate-is-spawned-not-opened | own-check.ps1 goes back to invoking the candidate with the call operator — 'PowerShell runs it either way, why the ceremony?'. It does not run it: it asks the platform to OPEN it, so a file the loader cannot start is handed to a desktop handler (notepad on Windows, xdg-open on Linux), the run exits 0 with empty streams, and Owen reports a clean finding-free analysis of nothing | caught | `ps1::ps1-not-started-is-2` |
83-
| P08 | ps1-agreement-replays-raw-bytes | own-check.ps1 drops the STDERR half of the agreement replay while leaving stdout byte-faithful — 'stderr is diagnostics, the result is stdout', which is how the original defect was written in the first place. It is the twin of P03 and exists because a single mutation that broke both streams could be killed by the stdout assertion alone: with this one, the stderr assertion is the only thing standing between the mutant and a green run | **not recorded** | — |
84-
| P09 | the-locator-is-a-preflight | own-check.ps1 checks that the .NET toolchain answers before it validates the locator — 'fail on the missing tool first', which plenty of CLIs do. The rejection it then produces is still correct in every observable way: exit 2, the absolute requirement named, no verdict. What it loses is the POSITION: a decision reachable from one environment variable now happens behind an external process, and on the real path that process is a Roslyn extraction over the caller's whole tree. Nothing in this control caught that until it began counting child processes | **not recorded** | — |
78+
| P08 | ps1-agreement-replays-raw-bytes | own-check.ps1 drops the STDERR half of the agreement replay while leaving stdout byte-faithful — 'stderr is diagnostics, the result is stdout', which is how the original defect was written in the first place. It is the twin of P03 and exists because a single mutation that broke both streams could be killed by the stdout assertion alone: with this one, the stderr assertion is the only thing standing between the mutant and a green run | caught | `ps1::ps1-agreement-replays` |
79+
| P09 | the-locator-is-a-preflight | own-check.ps1 checks that the .NET toolchain answers before it validates the locator — 'fail on the missing tool first', which plenty of CLIs do. The rejection it then produces is still correct in every observable way: exit 2, the absolute requirement named, no verdict. What it loses is the POSITION: a decision reachable from one environment variable now happens behind an external process, and on the real path that process is a Roslyn extraction over the caller's whole tree. Nothing in this control caught that until it began counting child processes | caught | `ps1::ps1-absolute-locator` |

0 commit comments

Comments
 (0)