Skip to content

Commit 1568cf3

Browse files
committed
Replace unblinded experiment packages
1 parent 645880e commit 1568cf3

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

‎docs/experiments/review-protocol.md‎

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,13 +12,15 @@ All eight issues are in `codeabovelab/guardyx-gstack`. A/B placement within each
1212
|---|---|---|---|---|
1313
| 1 — companion documentation | [#493](https://github.com/codeabovelab/guardyx-gstack/issues/493) / [PR #600](https://github.com/codeabovelab/guardyx-gstack/pull/600) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..6a273dab42005e01a6f4c2ea92297f40ad29e0d7` | [#176](https://github.com/codeabovelab/guardyx-gstack/issues/176) / [PR #601](https://github.com/codeabovelab/guardyx-gstack/pull/601) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..f61a793ebe4e7352f7ebf74238adfad3c18750d0` | Raw GitHub diff | codeboost |
1414
| 2 — agent-key security | [#506](https://github.com/codeabovelab/guardyx-gstack/issues/506) / [PR #602](https://github.com/codeabovelab/guardyx-gstack/pull/602) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..11a5d74d9bcdd0dcd1faa96e02cfe101ed9c8b6a` | [#443](https://github.com/codeabovelab/guardyx-gstack/issues/443) / [PR #603](https://github.com/codeabovelab/guardyx-gstack/pull/603) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..042999d9ebc3dc61fb029b21644bd20b4537a347` | codeboost | Raw GitHub diff |
15-
| 3 — asynchronous notifications | [#13](https://github.com/codeabovelab/guardyx-gstack/issues/13) / [PR #604](https://github.com/codeabovelab/guardyx-gstack/pull/604) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..6265ec3d7e0a023972000626a7309dbbf3c941cb` | [#429](https://github.com/codeabovelab/guardyx-gstack/issues/429) / [PR #605](https://github.com/codeabovelab/guardyx-gstack/pull/605) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..66a2dc798e5d1b187fd9110cf8df2b66e27ee489` | Raw GitHub diff | codeboost |
16-
| 4 — compliance evidence | [#504](https://github.com/codeabovelab/guardyx-gstack/issues/504) / [PR #606](https://github.com/codeabovelab/guardyx-gstack/pull/606) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..7a084a39a4bbbd0d3d78796407ec391acbce6095` | [#507](https://github.com/codeabovelab/guardyx-gstack/issues/507) / [PR #607](https://github.com/codeabovelab/guardyx-gstack/pull/607) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..0cc0096adeae699c6172fa7c9cb6e851aedd96ad` | codeboost | Raw GitHub diff |
15+
| 3 — asynchronous notifications | [#13](https://github.com/codeabovelab/guardyx-gstack/issues/13) / [PR #608](https://github.com/codeabovelab/guardyx-gstack/pull/608) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..78f62ee413a291a5f0ea555c39bc8d61b6721f9b` | [#429](https://github.com/codeabovelab/guardyx-gstack/issues/429) / [PR #609](https://github.com/codeabovelab/guardyx-gstack/pull/609) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..b8cd873ac688fa27ac841fb2e2df2d6d135446c6` | Raw GitHub diff | codeboost |
16+
| 4 — compliance evidence | [#504](https://github.com/codeabovelab/guardyx-gstack/issues/504) / [PR #610](https://github.com/codeabovelab/guardyx-gstack/pull/610) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..4ce1259c396ed40001efc02216a4cd181f8e50b4` | [#507](https://github.com/codeabovelab/guardyx-gstack/issues/507) / [PR #611](https://github.com/codeabovelab/guardyx-gstack/pull/611) / `f95a7ebaaa1e48a81fa724e8d6be677a17e7ee69..f9988770b89a14f006adf0ecefb15115d3d748d0` | codeboost | Raw GitHub diff |
1717

1818
The pairs are matched before implementation on repository, primary implementation language, scope, and expected review surface. Pair 1 changes operational/compliance documentation without runtime behavior; pair 2 changes agent-key lifecycle across the API and UI; pair 3 adds medium asynchronous notification delivery across backend jobs and consumer-facing interfaces; pair 4 adds compliance evidence across stored invocation data, exports, mapping data, and PDF surfaces. If implementation discovery makes a pair materially unequal or blocked, stop before the first timed review and record a new frozen protocol revision rather than silently substituting an issue.
1919

2020
Selection history: the first frozen draft paired #554 with #556. Before either implementation began, their required baseline check found that both depend on live 1,400-action/session telemetry unavailable from the operator's environment. A proposed replacement included #335, but inspect-before-build then proved that `main` already contains its requested in-flight guard even though the issue remains open. A current-tree audit also excluded other stale open issues whose requested work has shipped. The table above contains only work confirmed absent from current `main`; every A/B placement was randomized after that audit. No timed review, experimental implementation, or plant had started before this final selection.
2121

22+
Before timed review began, an automated reviewer was mistakenly requested on the original pair 3 and pair 4 draft PRs. That invalidated reviewer blindness for those four packages. PRs #604–#607 were closed, fresh randomized packages were created without changing their issues or method assignments, and the replacement PRs and exact revisions are recorded above. Automated review stays off every experimental draft until its human decision is recorded.
23+
2224
The reviewer must not implement the paired changes or inspect the plants before deciding on the PR. The operator must not expose plant inputs, `sealed.json`, mappings, planted locations, or unblinded implementation notes in the PR, review package, task messages, or protocol updates. An operator prepares plans and commits by hand, records trusted ledger ownership, and supplies both the plan and code to each review method. The earlier one-issue manual assignment is recorded in `manual-assignment.md`; all 12 segments were assigned and in scope, with no unclear case requiring another fixture.
2325

2426
## Planting

0 commit comments

Comments
 (0)