Skip to content

Commit 30f46a0

Browse files
tamirdresherCopilot
andcommitted
test: record verified upgrade matrix
Preserve the instrumented Linux and Windows results for the integrated product fixes. Closes #2538 Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
1 parent f6c8254 commit 30f46a0

2 files changed

Lines changed: 5765 additions & 46 deletions

File tree

‎docs/src/content/docs/scenarios/upgrading.md‎

Lines changed: 67 additions & 45 deletions
Original file line numberDiff line numberDiff line change
@@ -183,7 +183,12 @@ Every row below is a pinned, published artifact of an older Squad release driven
183183
184184
### Runs
185185

186-
_No runs recorded yet. The CI workflow `squad-upgrade-matrix.yml` records a run per OS at the tree under test; fold both artifacts with `node scripts/render-upgrade-matrix.mjs --merge <results.json>`._
186+
All recorded runs executed against **one tree**, commit `f6c82545c764f1e1fbf4dd19f3ec4606b93f85f2`, with harness hash `ed7a6a62ab80de5d…` (sha256 over the suite, renderer, workflow, fs hook and this fixture minus `runs`; the integrity test refuses a recorded run whose harness differs from the committed one, so folding results may change nothing but the runs data).
187+
188+
| Platform | Arch | Node | Target | Tree (targetSha) | Trigger | Recorded | Outcome |
189+
|----------|------|------|--------|------------------|---------|----------|---------|
190+
| Linux (`linux`) | x64 | v22.23.4 | v2.0.0 | `f6c82545c764` | [pull_request](https://github.com/github/squad/actions/runs/44559093526) | 2026-11-19 | 35 rows passed all non-xfail assertions; 4 of them carry a known expected failure (F3: Squad 0.9.1 squad upgrade --dry-run is not dry); 0 rows failed; 7 rows are structurally inapplicable (listed below). |
191+
| Windows (`win32`) | x64 | v22.23.5 | v2.0.0 | `f6c82545c764` | [pull_request](https://github.com/github/squad/actions/runs/44559093526) | 2026-11-19 | 35 rows passed all non-xfail assertions; 4 of them carry a known expected failure (F3: Squad 0.9.1 squad upgrade --dry-run is not dry); 0 rows failed; 7 rows are structurally inapplicable (listed below). |
187192

188193
_Earlier runs remain in `historicalRuns` in the fixture; they do not attest the current harness._
189194

@@ -214,50 +219,50 @@ npm tarballs are fetched by exact version through the registry npm is configured
214219

215220
### Results (version × shape × OS)
216221

217-
| Producer | Provenance | Shape | (no runs yet) |
218-
|----------|------------|-------|---|
219-
| **0.9.1** | npm | `default` | — |
220-
| **0.9.1** | npm | `profile` | — |
221-
| **0.9.1** | npm | `legacy-casting` | — |
222-
| **0.9.1** | npm | `orphan` | ⏭️ not applicable (see below) |
223-
| **0.9.1** | npm | `two-layer` | ⏭️ not applicable (see below) |
224-
| **0.9.1** | npm | `ai-team` | — |
225-
| **0.9.1** | npm | `upstream` | ⏭️ not applicable (see below) |
226-
| **0.13.1** | npm | `default` | — |
227-
| **0.13.1** | npm | `profile` | — |
228-
| **0.13.1** | npm | `legacy-casting` | — |
229-
| **0.13.1** | npm | `orphan` | — |
230-
| **0.13.1** | npm | `two-layer` | — |
231-
| **0.13.1** | npm | `ai-team` | — |
232-
| **0.13.1** | npm | `upstream` | ⏭️ not applicable (see below) |
233-
| **1.0.0** | npm | `default` | — |
234-
| **1.0.0** | npm | `profile` | — |
235-
| **1.0.0** | npm | `legacy-casting` | — |
236-
| **1.0.0** | npm | `orphan` | — |
237-
| **1.0.0** | npm | `two-layer` | — |
238-
| **1.0.0** | npm | `ai-team` | — |
239-
| **1.0.0** | npm | `upstream` | ⏭️ not applicable (see below) |
240-
| **1.0.1** | GitHub Release | `default` | — |
241-
| **1.0.1** | GitHub Release | `profile` | — |
242-
| **1.0.1** | GitHub Release | `legacy-casting` | — |
243-
| **1.0.1** | GitHub Release | `orphan` | — |
244-
| **1.0.1** | GitHub Release | `two-layer` | — |
245-
| **1.0.1** | GitHub Release | `ai-team` | — |
246-
| **1.0.1** | GitHub Release | `upstream` | ⏭️ not applicable (see below) |
247-
| **1.1.0** | GitHub Release | `default` | — |
248-
| **1.1.0** | GitHub Release | `profile` | — |
249-
| **1.1.0** | GitHub Release | `legacy-casting` | — |
250-
| **1.1.0** | GitHub Release | `orphan` | — |
251-
| **1.1.0** | GitHub Release | `two-layer` | — |
252-
| **1.1.0** | GitHub Release | `ai-team` | — |
253-
| **1.1.0** | GitHub Release | `upstream` | ⏭️ not applicable (see below) |
254-
| **HEAD** | local HEAD (pack) | `default` | — |
255-
| **HEAD** | local HEAD (pack) | `profile` | — |
256-
| **HEAD** | local HEAD (pack) | `legacy-casting` | — |
257-
| **HEAD** | local HEAD (pack) | `orphan` | — |
258-
| **HEAD** | local HEAD (pack) | `two-layer` | — |
259-
| **HEAD** | local HEAD (pack) | `ai-team` | — |
260-
| **HEAD** | local HEAD (pack) | `upstream` | — |
222+
| Producer | Provenance | Shape | Linux | Windows |
223+
|----------|------------|-------|---|---|
224+
| **0.9.1** | npm | `default` | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) |
225+
| **0.9.1** | npm | `profile` | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) |
226+
| **0.9.1** | npm | `legacy-casting` | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) |
227+
| **0.9.1** | npm | `orphan` | ⏭️ not applicable — `@bradygaster/squad-cli@0.9.1` has no `--state-backend` flag (first shipped in 0.13.x), so an orphan-backend project cannot be produced by it. | ⏭️ not applicable — `@bradygaster/squad-cli@0.9.1` has no `--state-backend` flag (first shipped in 0.13.x), so an orphan-backend project cannot be produced by it. |
228+
| **0.9.1** | npm | `two-layer` | ⏭️ not applicable — `@bradygaster/squad-cli@0.9.1` has no `--state-backend` flag (first shipped in 0.13.x), so a two-layer-backend project cannot be produced by it. | ⏭️ not applicable — `@bradygaster/squad-cli@0.9.1` has no `--state-backend` flag (first shipped in 0.13.x), so a two-layer-backend project cannot be produced by it. |
229+
| **0.9.1** | npm | `ai-team` | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) | ✅⚠️ pass WITH known destructive downgrade-probe failure (F3) |
230+
| **0.9.1** | npm | `upstream` | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 0.9.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 0.9.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. |
231+
| **0.13.1** | npm | `default` | ✅ pass | ✅ pass |
232+
| **0.13.1** | npm | `profile` | ✅ pass | ✅ pass |
233+
| **0.13.1** | npm | `legacy-casting` | ✅ pass | ✅ pass |
234+
| **0.13.1** | npm | `orphan` | ✅ pass | ✅ pass |
235+
| **0.13.1** | npm | `two-layer` | ✅ pass | ✅ pass |
236+
| **0.13.1** | npm | `ai-team` | ✅ pass | ✅ pass |
237+
| **0.13.1** | npm | `upstream` | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 0.13.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 0.13.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. |
238+
| **1.0.0** | npm | `default` | ✅ pass | ✅ pass |
239+
| **1.0.0** | npm | `profile` | ✅ pass | ✅ pass |
240+
| **1.0.0** | npm | `legacy-casting` | ✅ pass | ✅ pass |
241+
| **1.0.0** | npm | `orphan` | ✅ pass | ✅ pass |
242+
| **1.0.0** | npm | `two-layer` | ✅ pass | ✅ pass |
243+
| **1.0.0** | npm | `ai-team` | ✅ pass | ✅ pass |
244+
| **1.0.0** | npm | `upstream` | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.0.0 cannot declare an upstream, so there is nothing for the upgrade to preserve. | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.0.0 cannot declare an upstream, so there is nothing for the upgrade to preserve. |
245+
| **1.0.1** | GitHub Release | `default` | ✅ pass | ✅ pass |
246+
| **1.0.1** | GitHub Release | `profile` | ✅ pass | ✅ pass |
247+
| **1.0.1** | GitHub Release | `legacy-casting` | ✅ pass | ✅ pass |
248+
| **1.0.1** | GitHub Release | `orphan` | ✅ pass | ✅ pass |
249+
| **1.0.1** | GitHub Release | `two-layer` | ✅ pass | ✅ pass |
250+
| **1.0.1** | GitHub Release | `ai-team` | ✅ pass | ✅ pass |
251+
| **1.0.1** | GitHub Release | `upstream` | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.0.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.0.1 cannot declare an upstream, so there is nothing for the upgrade to preserve. |
252+
| **1.1.0** | GitHub Release | `default` | ✅ pass | ✅ pass |
253+
| **1.1.0** | GitHub Release | `profile` | ✅ pass | ✅ pass |
254+
| **1.1.0** | GitHub Release | `legacy-casting` | ✅ pass | ✅ pass |
255+
| **1.1.0** | GitHub Release | `orphan` | ✅ pass | ✅ pass |
256+
| **1.1.0** | GitHub Release | `two-layer` | ✅ pass | ✅ pass |
257+
| **1.1.0** | GitHub Release | `ai-team` | ✅ pass | ✅ pass |
258+
| **1.1.0** | GitHub Release | `upstream` | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.1.0 cannot declare an upstream, so there is nothing for the upgrade to preserve. | ⏭️ not applicable — Upstream inheritance (`.squad/upstream.json`, `squad upstream add`) is a Squad 2.0 feature; 1.1.0 cannot declare an upstream, so there is nothing for the upgrade to preserve. |
259+
| **HEAD** | local HEAD (pack) | `default` | ✅ pass | ✅ pass |
260+
| **HEAD** | local HEAD (pack) | `profile` | ✅ pass | ✅ pass |
261+
| **HEAD** | local HEAD (pack) | `legacy-casting` | ✅ pass | ✅ pass |
262+
| **HEAD** | local HEAD (pack) | `orphan` | ✅ pass | ✅ pass |
263+
| **HEAD** | local HEAD (pack) | `two-layer` | ✅ pass | ✅ pass |
264+
| **HEAD** | local HEAD (pack) | `ai-team` | ✅ pass | ✅ pass |
265+
| **HEAD** | local HEAD (pack) | `upstream` | ✅ pass | ✅ pass |
261266

262267
### Not-applicable cells, each explained
263268

@@ -386,6 +391,23 @@ Observed: `idempotent-second-upgrade` fails with exactly `.github/agents/squad.a
386391

387392
Resolved: Fixed on squad2-c @ 50afa91a (PR #2279): `runUpgrade` runs `preflightCastingPair()` (ensureCastingDefaults) before `writeAgentTemplate` in both the already-current and the normal path, so a 0.9.x project with an empty `.squad/casting/` gets the `<!-- squad:capabilities -->` block on the first upgrade and the second upgrade is byte-identical (C test: `test/upgrade-profile-teamroot.test.ts` › "F4: a 0.9.x project (empty casting/) upgrades in ONE pass"). Verified by this matrix: with the pin still in place, `idempotent-second-upgrade` produced `xpass` on exactly 0.9.1 × default/profile/ai-team; the pin is removed.
388393

394+
### Unsupported downgrade — what each old CLI does to an upgraded repository
395+
396+
Recorded by the `downgrade-probe` check (dry-run on a copy; the only assertion is "modified nothing"). This is **not** a supported path — see the warning at the top of this section.
397+
398+
| Platform | Producer | Shapes | Observed |
399+
|----------|----------|--------|----------|
400+
| `linux` | 0.9.1 | all 4 shapes | exit 0, last lines "✓ refreshed .squad/templates/ \| Upgrade complete: v2.0.0 → v0.9.1 \| Preserves user state: team.md, decisions/, agents/*/history.md"; MODIFIED 68 files (20 coordinator/templates/workflows, e.g. .copilot/skills/agent-collaboration/SKILL.md, .copilot/skills/agent-conduct/SKILL.md, .copilot/skills/architectural-proposals/SKILL.md …) |
401+
| `linux` | 0.13.1 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
402+
| `linux` | 1.0.0 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
403+
| `linux` | 1.0.1 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
404+
| `linux` | 1.1.0 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
405+
| `win32` | 0.9.1 | all 4 shapes | exit 0, last lines "✓ refreshed .squad/templates/ \| Upgrade complete: v2.0.0 → v0.9.1 \| Preserves user state: team.md, decisions/, agents/*/history.md"; MODIFIED 67 files (20 coordinator/templates/workflows, e.g. .copilot/skills/agent-collaboration/SKILL.md, .copilot/skills/agent-conduct/SKILL.md, .copilot/skills/architectural-proposals/SKILL.md …) |
406+
| `win32` | 0.13.1 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
407+
| `win32` | 1.0.0 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
408+
| `win32` | 1.0.1 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
409+
| `win32` | 1.1.0 | all 6 shapes | exit 0, last lines "overwrite ../.github/workflows/squad-triage.yml \| overwrite ../.github/workflows/sync-squad-labels.yml \| Run without --dry-run to apply."; modified nothing |
410+
389411
<!-- UPGRADE-MATRIX:END -->
390412

391413
---

0 commit comments

Comments
 (0)