From 61f7781297e3b900b2cb6828e859a84dbff4647c Mon Sep 17 00:00:00 2001 From: Algis Dumbris Date: Tue, 25 Aug 2026 06:52:08 +0300 Subject: [PATCH] =?UTF-8?q?chore(roadmap):=20sync=20statuses=20=E2=80=94?= =?UTF-8?q?=20QA-gate=20T2=20done,=20mcp-2026=20unblocked,=20specs=20101/1?= =?UTF-8?q?02=20tracked?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - release-qa-gate-playwright (T2): in_review -> done, pr #1030 (advisory Playwright web-UI sweep merged into the release gate). - mcp-2026-upgrade: blocked -> in_progress. The mcp-go gate cleared with v1.0.0-beta.1 (2026-08-12); spec 058 revision in review as #1033. Note rewritten: the remaining blocker is the Spec 057 cross-spec conflict, not the dependency. - tpa-db: todo -> in_review with spec: specs/101-tpa-db and pr #1028 (spec stage only; all three child tasks stay todo). - New epic schema-deferred (P1, spec 102, in_progress): deferred-schema serialization for the direct tools/list surface, spec merged in #1035 (issue #971), plan in progress. Reconnect-backoff work (#1014/#1039/#1040) is deliberately not added β€” the roadmap never tracked it; git history does. ROADMAP.md regenerated; gen-roadmap.py --check passes. --- ROADMAP.md | 102 +++++++++++++++++++++++++++++---------------------- roadmap.yaml | 22 ++++++++--- 2 files changed, 75 insertions(+), 49 deletions(-) diff --git a/ROADMAP.md b/ROADMAP.md index c08ca0a79..e70d67859 100644 --- a/ROADMAP.md +++ b/ROADMAP.md @@ -58,17 +58,20 @@ graph LR classDef done fill:#1f7a1f,stroke:#0d3d0d,color:#ffffff; classDef in_progress fill:#1f6feb,stroke:#0b3d91,color:#ffffff; + classDef in_review fill:#9a6700,stroke:#5c3d00,color:#ffffff; classDef todo fill:#6e7781,stroke:#3d4248,color:#ffffff; class sandbox_isolation,scanner_v2,scanner_simplification done; class analytics_dashboard,telemetry_identity,telemetry_v7_churn in_progress; - class ux_audit,action_log_transparency,tpa_db,remote_access_tunnel todo; + class tpa_db in_review; + class ux_audit,action_log_transparency,remote_access_tunnel todo; ``` -**Independent epics** (15) β€” no cross-epic prerequisites; each stands alone: +**Independent epics** (16) β€” no cross-epic prerequisites; each stands alone: - πŸ”΅ **Release qualification gate (auto-QA matrix blocks the tag)** β€” In progress Β· P0 +- πŸ”΅ **Deferred-schema serialization for the direct tools/list surface (spec 102)** β€” In progress Β· P1 +- πŸ”΅ **MCP protocol upgrade to 2026-07-28 revision** β€” In progress Β· P3 - 🟑 **Windows native tray app** β€” In review Β· P2 -- πŸ”΄ **MCP protocol upgrade to 2026-07-28 revision** β€” Blocked Β· P3 - βšͺ **Planning/docs truth automation** β€” Todo Β· P2 - ⚫ **Server marketplace** β€” Todo Β· P3 Β· parked - ⚫ **Audit SIEM integration** β€” Todo Β· P3 Β· parked @@ -105,17 +108,15 @@ graph LR release_qa_gate_matrix --> release_qa_gate_consistency classDef done fill:#1f7a1f,stroke:#0d3d0d,color:#ffffff; - classDef in_review fill:#9a6700,stroke:#5c3d00,color:#ffffff; classDef todo fill:#6e7781,stroke:#3d4248,color:#ffffff; - class release_qa_gate_matrix done; - class release_qa_gate_playwright in_review; + class release_qa_gate_matrix,release_qa_gate_playwright done; class release_qa_gate_macos,release_qa_gate_consistency todo; ``` | Task | Status | Refs | | --- | --- | --- | | T1: tag-blocking release-gate workflow: server-type matrix (stdio/http/sse/docker/oauth) + invariants (activity-log/request-id, token+telemetry counters, quarantine flow, reconnect, upgrade-in-place), publish jobs gated on the verdict, scan-eval unconditional on tags | 🟒 Done | #819 | -| T2: wire the Playwright Web UI sweep into the gate (currently manual-trigger only) | 🟑 In review | β€” | +| T2: wire the Playwright Web UI sweep into the gate (currently manual-trigger only) | 🟒 Done | #1030 | | T3: macOS app smoke on a macos runner, advisory until 3 consecutive passes (today zero CI automation for the tray app) | βšͺ Todo | β€” | | T4: surface-state consistency check (tray/Web UI/CLI agree with core on server states) | βšͺ Todo | β€” | @@ -148,6 +149,15 @@ graph LR +
+πŸ”΅ Deferred-schema serialization for the direct tools/list surface (spec 102) β€” In progress Β· P1 + +> Direct mode enumerates every upstream tool but always ships full inputSchema (~30K tokens for a 100-tool fleet; Spec 083 profiling put ~77% of the payload in schemas agents rarely read). Deferred serialization keeps every tool name, description and annotation and appends the Spec 085 compact signature instead of the schema (~88% smaller listing), with describe_tool on the direct surface to recover it and the shipped pre-dispatch validation turning a wrong guess into one self-healing retry. Not a new routing_mode β€” a serialization mode of the direct surface, on the same tool_response_mode axis that already governs retrieve_tools. Spec merged in #1035 (issue #971, maintainer-accepted direction); plan in progress. + +Spec: [102-schema-deferred](./specs/102-schema-deferred/) + +
+
πŸ”΅ Telemetry identity & data quality (machine_id + CI-filter hardening) β€” In progress Β· P1 @@ -216,6 +226,43 @@ graph LR
+
+πŸ”΅ MCP protocol upgrade to 2026-07-28 revision β€” In progress Β· P3 + +> UNBLOCKED 2026-08-12: the mcp-go gate cleared β€” v1.0.0-beta.1 (mark3labs/mcp-go#951) ships full 2026-07-28 support with per-request era detection (the pin was v0.55.x, topping out at 2025-11-25). Spec 058 revision in review as #1033: final error-code renumbering (-32020/-32021/-32022), FR-001..006 / FR-014..016 recast as adopt-and-verify, FR-028 legacy-only transport pin as the safe merge state, plus Risks & Watch Items. CROSS-SPEC CONFLICT still open and now the mandatory first task: FR-012 forbids per-connection */list variation; SHIPPED Spec 057 selects toolset by URL path /mcp/p/ β€” Option A/B decided at plan time (acceptance = the 2 tests failing under beta.1). 028 agent-token scoping is already compatible (header-carried). Tracker: #532. + +Spec: [058-mcp-2026-upgrade](./specs/058-mcp-2026-upgrade/) Β· PR: #1033 + +
+ +
+🟑 tpa-db: versioned TPA signature database for the offline scanner β€” In review Β· P1 + +> Vision pillar 'feel protected': the deterministic detect engine (Spec 076/077) ships with built-in checks but no updatable knowledge of in-the-wild Tool Poisoning Attacks. Build a versioned, offline-first signature/pattern database (known TPA campaigns, malicious phrase corpora, IoC hashes) that the engine consumes β€” bundled with the binary, refreshable out-of-band, community-contributable, and guarded by the existing scan-eval recall/FP CI gate. SPEC STAGE: specs/101-tpa-db is in review as #1028 (merge-on-convergence armed); no implementation has started, so every child task stays todo. + +Spec: [101-tpa-db](./specs/101-tpa-db/) Β· PR: #1028 + +```mermaid +graph LR + tpa_db_format["Signature DB format + loader (versioned, sign…"] + tpa_db_corpus["Seed corpus: catalog known public TPA campaig…"] + tpa_db_refresh["Out-of-band refresh (offline-friendly: manual…"] + + tpa_db_format --> tpa_db_corpus + tpa_db_format --> tpa_db_refresh + + classDef todo fill:#6e7781,stroke:#3d4248,color:#ffffff; + class tpa_db_format,tpa_db_corpus,tpa_db_refresh todo; +``` + +| Task | Status | Refs | +| --- | --- | --- | +| Signature DB format + loader (versioned, signed, bundled default) | βšͺ Todo | β€” | +| Seed corpus: catalog known public TPA campaigns/patterns into the DB | βšͺ Todo | β€” | +| Out-of-band refresh (offline-friendly: manual file drop + optional fetch), eval-gated | βšͺ Todo | β€” | + +
+
🟑 Windows native tray app β€” In review Β· P2 Β· MCP-43 @@ -241,15 +288,6 @@ graph LR
-
-πŸ”΄ MCP protocol upgrade to 2026-07-28 revision β€” Blocked Β· P3 - -> BLOCKED on mcp-go shipping 2026-07-28 (pinned v0.55.x tops out at 2025-11-25). CROSS-SPEC CONFLICT: FR-012 forbids per-connection */list variation; SHIPPED Spec 057 selects toolset by URL path /mcp/p/. Must reconcile at plan time (058 spec now carries a Cross-Spec Reconciliation note). 028 agent-token scoping is already compatible (header-carried). - -Spec: [058-mcp-2026-upgrade](./specs/058-mcp-2026-upgrade/) - -
-
βšͺ Web UI + macOS app UX audit β€” Todo Β· P0 @@ -304,32 +342,6 @@ graph LR
-
-βšͺ tpa-db: versioned TPA signature database for the offline scanner β€” Todo Β· P1 - -> Vision pillar 'feel protected': the deterministic detect engine (Spec 076/077) ships with built-in checks but no updatable knowledge of in-the-wild Tool Poisoning Attacks. Build a versioned, offline-first signature/pattern database (known TPA campaigns, malicious phrase corpora, IoC hashes) that the engine consumes β€” bundled with the binary, refreshable out-of-band, community-contributable, and guarded by the existing scan-eval recall/FP CI gate. - -```mermaid -graph LR - tpa_db_format["Signature DB format + loader (versioned, sign…"] - tpa_db_corpus["Seed corpus: catalog known public TPA campaig…"] - tpa_db_refresh["Out-of-band refresh (offline-friendly: manual…"] - - tpa_db_format --> tpa_db_corpus - tpa_db_format --> tpa_db_refresh - - classDef todo fill:#6e7781,stroke:#3d4248,color:#ffffff; - class tpa_db_format,tpa_db_corpus,tpa_db_refresh todo; -``` - -| Task | Status | Refs | -| --- | --- | --- | -| Signature DB format + loader (versioned, signed, bundled default) | βšͺ Todo | β€” | -| Seed corpus: catalog known public TPA campaigns/patterns into the DB | βšͺ Todo | β€” | -| Out-of-band refresh (offline-friendly: manual file drop + optional fetch), eval-gated | βšͺ Todo | β€” | - -
-
βšͺ Remote access tunnel (feature-flagged MVP, spec 089) β€” Todo Β· P2 @@ -666,13 +678,14 @@ graph LR | --- | --- | --- | --- | --- | --- | | Release qualification gate (auto-QA matrix blocks the tag) | In progress | P0 | β€” | [081-release-qa-gate](./specs/081-release-qa-gate/) | | | Analytics dashboard as default page | In progress | P1 | 25/26 (96%) | [069-observability-usage-graphs](./specs/069-observability-usage-graphs/) | | +| Deferred-schema serialization for the direct tools/list surface (spec 102) | In progress | P1 | β€” | [102-schema-deferred](./specs/102-schema-deferred/) | | | Telemetry identity & data quality (machine_id + CI-filter hardening) | In progress | P1 | β€” | | | | Telemetry v7: honest funnel + churn instrumentation | In progress | P1 | β€” | [080-telemetry-v7-churn](./specs/080-telemetry-v7-churn/) | | +| MCP protocol upgrade to 2026-07-28 revision | In progress | P3 | β€” | [058-mcp-2026-upgrade](./specs/058-mcp-2026-upgrade/) | #1033 | +| tpa-db: versioned TPA signature database for the offline scanner | In review | P1 | β€” | [101-tpa-db](./specs/101-tpa-db/) | #1028 | | Windows native tray app `MCP-43` | In review | P2 | β€” | | | -| MCP protocol upgrade to 2026-07-28 revision | Blocked | P3 | β€” | [058-mcp-2026-upgrade](./specs/058-mcp-2026-upgrade/) | | | Web UI + macOS app UX audit | Todo | P0 | β€” | | | | Action log / transparency β€” info at a glance | Todo | P1 | β€” | | | -| tpa-db: versioned TPA signature database for the offline scanner | Todo | P1 | β€” | | | | Remote access tunnel (feature-flagged MVP, spec 089) | Todo | P2 | β€” | [089-remote-access-tunnel](./specs/089-remote-access-tunnel/) | | | Planning/docs truth automation | Todo | P2 | β€” | | | | Security gateway Tracks C/D (per-arg least-privilege + signature provenance) | Todo | P3 | β€” | [054-mcp-security-gateway](./specs/054-mcp-security-gateway/) | | @@ -804,3 +817,4 @@ Legend: `shipped` β‰₯95% checked Β· `in-flight` 1–94% Β· `drafted` 0% Β· `β€”` | [098-tools-preflight](./specs/098-tools-preflight/) | `in-flight` | 26/33 (79%) | | [099-describe-check-mode](./specs/099-describe-check-mode/) | `in-flight` | 9/10 (90%) | | [100-prompt-rugpull-baseline](./specs/100-prompt-rugpull-baseline/) | β€” | β€” | +| [102-schema-deferred](./specs/102-schema-deferred/) | β€” | β€” | diff --git a/roadmap.yaml b/roadmap.yaml index d6115edc5..17bc0036f 100644 --- a/roadmap.yaml +++ b/roadmap.yaml @@ -295,10 +295,12 @@ epics: - id: tpa-db title: "tpa-db: versioned TPA signature database for the offline scanner" - status: todo + status: in_review priority: P1 + spec: specs/101-tpa-db + pr: "#1028" depends_on: [scanner-simplification] - note: "Vision pillar 'feel protected': the deterministic detect engine (Spec 076/077) ships with built-in checks but no updatable knowledge of in-the-wild Tool Poisoning Attacks. Build a versioned, offline-first signature/pattern database (known TPA campaigns, malicious phrase corpora, IoC hashes) that the engine consumes β€” bundled with the binary, refreshable out-of-band, community-contributable, and guarded by the existing scan-eval recall/FP CI gate." + note: "Vision pillar 'feel protected': the deterministic detect engine (Spec 076/077) ships with built-in checks but no updatable knowledge of in-the-wild Tool Poisoning Attacks. Build a versioned, offline-first signature/pattern database (known TPA campaigns, malicious phrase corpora, IoC hashes) that the engine consumes β€” bundled with the binary, refreshable out-of-band, community-contributable, and guarded by the existing scan-eval recall/FP CI gate. SPEC STAGE: specs/101-tpa-db is in review as #1028 (merge-on-convergence armed); no implementation has started, so every child task stays todo." tasks: - id: tpa-db-format title: "Signature DB format + loader (versioned, signed, bundled default)" @@ -338,6 +340,14 @@ epics: status: todo depends_on: [tunnel-orchestration, tunnel-exposure-allowlist] + - id: schema-deferred + title: "Deferred-schema serialization for the direct tools/list surface (spec 102)" + status: in_progress + priority: P1 + spec: specs/102-schema-deferred + depends_on: [] + note: "Direct mode enumerates every upstream tool but always ships full inputSchema (~30K tokens for a 100-tool fleet; Spec 083 profiling put ~77% of the payload in schemas agents rarely read). Deferred serialization keeps every tool name, description and annotation and appends the Spec 085 compact signature instead of the schema (~88% smaller listing), with describe_tool on the direct surface to recover it and the shipped pre-dispatch validation turning a wrong guess into one self-healing retry. Not a new routing_mode β€” a serialization mode of the direct surface, on the same tool_response_mode axis that already governs retrieve_tools. Spec merged in #1035 (issue #971, maintainer-accepted direction); plan in progress." + # ── TELEMETRY-DRIVEN REPLAN (2026-07-02) ────────────────────────────────── - id: upgrade-nudge title: Upgrade awareness & guided update @@ -449,7 +459,8 @@ epics: depends_on: [] - id: release-qa-gate-playwright title: "T2: wire the Playwright Web UI sweep into the gate (currently manual-trigger only)" - status: in_review + status: done + pr: "#1030" priority: P2 note: "Landed ADVISORY, not blocking (FR-016 wants blocking eventually). The sweep itself is now committed (e2e/web-ui-sweep: servers list, server detail + security tab, tools page + search, activity log, settings; uncaught page exceptions fail it) and scripts/run-web-smoke.sh β€” previously dead, it pointed at a spec file that lives in a gitignored dir β€” is its single launcher for both `./scripts/run-web-smoke.sh` by hand and the gate's `web-ui-sweep` job. Advisory is enforced twice: continue-on-error on the job (a failing job inside a reusable workflow would otherwise become the workflow_call conclusion the publishers gate on) and a non-blocking manifest entry advisory/web-ui-sweep (renamed from reserved/web-ui-sweep) whose failures land in advisory_failures via the new `release-gate run-suite --advisory` flag. Promotion to blocking = Blocking:true + drop continue-on-error, after 3 consecutive clean tags." depends_on: [release-qa-gate-matrix] @@ -603,11 +614,12 @@ epics: # are the genuinely-unbuilt ones. See docs/personal-edition-polish.md audit. - id: mcp-2026-upgrade title: MCP protocol upgrade to 2026-07-28 revision - status: blocked + status: in_progress priority: P3 spec: specs/058-mcp-2026-upgrade + pr: "#1033" depends_on: [] - note: "BLOCKED on mcp-go shipping 2026-07-28 (pinned v0.55.x tops out at 2025-11-25). CROSS-SPEC CONFLICT: FR-012 forbids per-connection */list variation; SHIPPED Spec 057 selects toolset by URL path /mcp/p/. Must reconcile at plan time (058 spec now carries a Cross-Spec Reconciliation note). 028 agent-token scoping is already compatible (header-carried)." + note: "UNBLOCKED 2026-08-12: the mcp-go gate cleared β€” v1.0.0-beta.1 (mark3labs/mcp-go#951) ships full 2026-07-28 support with per-request era detection (the pin was v0.55.x, topping out at 2025-11-25). Spec 058 revision in review as #1033: final error-code renumbering (-32020/-32021/-32022), FR-001..006 / FR-014..016 recast as adopt-and-verify, FR-028 legacy-only transport pin as the safe merge state, plus Risks & Watch Items. CROSS-SPEC CONFLICT still open and now the mandatory first task: FR-012 forbids per-connection */list variation; SHIPPED Spec 057 selects toolset by URL path /mcp/p/ β€” Option A/B decided at plan time (acceptance = the 2 tests failing under beta.1). 028 agent-token scoping is already compatible (header-carried). Tracker: #532." - id: security-gateway-cd title: Security gateway Tracks C/D (per-arg least-privilege + signature provenance) status: todo