Repository navigation
Description
Goal
Make desktop behavior and package-cost claims for the agentic component library provable through one supported desktop-driver/Storybook workflow, truthful native coverage, reproducible package boundaries, and optional reviewer-facing visual evidence.
Status - 2026-11-09
In progress: 22 direct sub-issues; 10 closed and 12 open.
This reconciliation audits merged main at 138aed4cd. Changes since 2026-10-01:
- Infrastructure: Reject all-skipped WDIO runs as completed coverage #4342 is closed. Desktop testing: declare and select WDIO cases by input lane, platform and scope #4464 fixed it: an all-skipped selection is no longer reported as completed coverage. Broader outcome classification remains in Infrastructure: Qualify and require native Storybook CI coverage #4349.
- Infrastructure: Desktop driver improvements for workload hosting, lifecycle, and agent orchestration #4435 (desktop driver improvements) is a direct sub-issue. It tracks the workload-hosting, lifecycle, recovery, ownership, handoff, MCP-management and support-baseline work across
desktop-driver,desktop-test,desktop-driver-mcpand the Storybook desktop packages.- Its implementation items F1-F8, F10-M, F10-W, F11, F12 and F16 are merged and closed (refreshed 2026-11-16). Remaining native qualification is consolidated in Infrastructure: Live-qualify the desktop driver and MCP foundation on macOS, Windows, and Win32 #4441, the support baseline in Infrastructure: Qualify desktop lifecycle failure paths and maintain a support matrix #4451, and the Storybook and management follow-ups in Infrastructure: Convert Storybook lifecycle takeover into desktop-test resource contributions #4449 and Infrastructure: Add the generalized desktop-mcp management facet #4450.
- Infrastructure: Complete Desktop Driver production release qualification #4345, Infrastructure: Qualify Windows/Win32 capture fidelity and provenance #4348 and Infrastructure: Qualify and require native Storybook CI coverage #4349 remain the release, capture and required-CI gates. Infrastructure: Desktop driver improvements for workload hosting, lifecycle, and agent orchestration #4435's items coordinate with them rather than replacing them.
- Infrastructure: Qualify native-core Win32 capabilities, peer floors, publishing, and root admission #4376 and Infrastructure: Qualify native-core TurboModule support with a real consumer #4380 were added during native-core modernization (Modernize native-core desktop primitives and track remaining qualification #4381). Infrastructure: Qualify native-core Win32 capabilities, peer floors, publishing, and root admission #4376 covers Win32 capabilities, peer floors, publishing and root admission. Infrastructure: Qualify native-core TurboModule support with a real consumer #4380 waits for a real TurboModule consumer.
- Infrastructure: Restore Storybook stories excluded by native desktop crashes #4344 is partly addressed. Modernize native-core desktop primitives and track remaining qualification #4381 restored Callout on Windows Fabric. Windows Fabric still excludes Accordion, and Win32 Paper still excludes Accordion and ListItem.
- Input lanes:
- Desktop testing: declare and select WDIO cases by input lane, platform and scope #4464 and Desktop testing: migrate stories and split CI input lanes #4466 migrated authored story callbacks to
desktopItdescriptors. - Desktop testing: migrate stories and split CI input lanes #4466 split Windows/Win32 CI into a masked
--input accessiblelane plus a separate, unmasked Win32--input physicalpilot. macOS CI remains in compatibility mode. - Desktop testing: enforce session input policy #4468 enforces session input policy with delivered-input receipts.
- No Storybook job is part of the aggregate
PRcheck. Promotion stays in Infrastructure: Qualify and require native Storybook CI coverage #4349.
- Desktop testing: declare and select WDIO cases by input lane, platform and scope #4464 and Desktop testing: migrate stories and split CI input lanes #4466 migrated authored story callbacks to
- Windows qualification: Qualify Windows desktop-driver ownership and physical input #4469 added Win32 Job Object containment. It also recorded connected physical-input smokes passing at
fec94cec4: Windows Fabric 203/203 and Win32 Paper 177/177. These are local, per-probe records, not required CI.
The sections below date from the 2026-10-01 reconciliation unless noted; where they disagree, this status wins.
Status - 2026-10-01
19 direct sub-issues at the time; 9 completed delivery milestones and 10 open qualification/follow-up/bug items.
This reconciliation audits merged main at c3a89b0b7 and current native CI evidence. The original ten children were reviewed individually. Completed delivery is now separated from remaining original acceptance criteria: #4253/#4254/#4255/#4256/#4260 are closed as delivered milestones, with unfinished work preserved in new direct sub-issues. Existing completed #4257/#4258/#4259/#4279 remain closed. #4328 remains open.
Closure means the described milestone landed, not that its later production qualification is complete.
Repository evidence - 2026-10-01 baseline
- Desktop Driver: public Appium-independent W3C package, source-built macOS and shared Windows/Win32 native providers, verified native artifact selection, exact app ownership, cancellation/input recovery, normalized accessibility, native capture, and shared Storybook integration are merged (Infrastructure: land the public desktop driver #4294/Infrastructure: add native desktop driver providers #4306).
- Story authoring: named, typed
wdiocallbacks replace component-catalog static plans; authenticated readiness, callback source verification, isolated workers/sessions, and grouped owned smoke are implemented (Add wdio test support in stories #4313/Fix desktop focus management and accessibility action handling #4314). Current discovery is 29 cases across 17 stories and ten component/primitive families on each endpoint. - Catalogs: current generated manifests contain 168 macOS, 158 Windows Fabric, and 152 Win32 Paper stories. Fabric excludes Accordion/Callout; Paper excludes Accordion/ListItem because of native fail-fast problems, now explicitly tracked in Infrastructure: Restore Storybook stories excluded by native desktop crashes #4344. (2026-11-09: Callout was restored on Fabric by Modernize native-core desktop primitives and track remaining qualification #4381.)
- Native CI: all three Storybook jobs passed in October 1 run 36927750317, each with 7 authored passes / 22 skips. Windows/Win32 disable keyboard, physical click, and wheel; hosted macOS disables physical click. These results prove only executed assertions/capabilities, not full interactive qualification.
- Required-status policy: main currently requires
PR; that aggregate excludes Storybook and bundle-size jobs. Green optional jobs or a green aggregate are not required desktop/package-cost gates (Infrastructure: Qualify and require native Storybook CI coverage #4349/Infrastructure: Enforce package-cost budgets and production dependency boundaries #4341). - Package cost: seven macOS/Windows esbuild scenarios, baselines, workspace attribution, optional-module rules, and trusted persistent advisory PR reports exist. Two current-main measurements produce identical inputs for all 14 combinations (Faster and more concise bundle-size reports #4335). This measures tree-shaken package JavaScript with native/React peers externalized, not total application size. Required budgets, complete dependency enforcement, primitives/archives, and promotion policy remain Infrastructure: Enforce package-cost budgets and production dependency boundaries #4341.
- Capture/visuals: native window/element capture is implemented, but Windows/Win32 fidelity/DPI/provenance/session qualification remains Infrastructure: Qualify Windows/Win32 capture fidelity and provenance #4348. Native baseline/candidate/diff reports are not implemented (Infrastructure: Add native Storybook visual comparison reports for Windows, Win32, and macOS #4328).
portablePlanDigest hashes legacy static plans, currently an empty set in the component catalog. Matching it is not proof of WDIO callback equivalence; production reconciliation must include actual callback/source and endpoint catalog identities.
Open work items
| Issue | State | Remaining outcome |
|---|---|---|
| #4341 - Required package-cost gates | Open, foundation delivered | Reviewed absolute/percentage budgets, required-status wiring, dependency/unused-declaration enforcement, public primitives/archives, reproducible metadata, and baseline review policy. |
| #4343 - Accessibility completion | Open, foundation delivered | Full initial role/name/state/value and positive/negative keyboard cohort, Switch mapping, accessibility summaries, and authoritative native proof. |
| #4344 - Native catalog crashes | Open, partly restored | Fabric Callout restored by #4381. Restore Accordion on Fabric and Accordion/ListItem on Paper after current native reproduction/fix/regression proof. |
| #4345 - Driver release qualification | Open, implementation delivered | Complete authoritative Windows/macOS qualification and compatibility, security, cache, performance, reliability, package/external-consumer, and publishing gates in the package plan. |
| #4346 - Native accessibility-state gaps | Open, documented native gaps | Resolve/requalify macOS disabled/selected AX state and Win32 Input enabled-state reporting; remove skips only after native evidence. |
| #4347 - Focus-regression parity | Open, retirement delivered | Restore ten minimum-three-second focus-survival cases, Button real Tab movement, and original visibility/status parity in active native CI. |
| #4348 - Capture qualification | Open, backend delivered | Windows/Win32 live 100/150/200% DPI/crop/Composition fidelity, provenance, interactive reliability, and locked-session diagnostics. |
| #4349 - Required native CI | Open, pipelines and input lanes delivered (#4466) | Authoritative runners, real cohort/digest/reporting evidence, outcome classification, retry/quarantine and named operating policies, managed macOS input lanes, physical-lane promotion, measured reliability, and required promotion. |
| #4328 - Visual comparison reports | Open, not implemented | Button/Checkbox/Input native before/after/diff pilot, noise/baseline governance, and advisory PR reviewer reports on all three endpoints. |
| #4435 - Desktop driver improvements | Open epic; F1-F8, F10-M, F10-W, F11, F12, F16 delivered | Remaining open items: - F9 #4449: Storybook contributions - F13 #4450: management tools - F14 #4451: support baseline (blocked by #4441) - F15 #4441: native qualification See #4435 for active blockers. |
| #4376 - native-core Win32/publishing admission | Open | Supported React/RN/fork/renderer matrix, Win32 capability evidence, publishing/peer floors, and platform-preview versus root admission. |
| #4380 - native-core TurboModule consumer | Open, deferred until a real consumer exists | A genuine non-view module consumer, verified codegen/registration, lifecycle and cleanup in real consuming hosts. |
Completed delivery milestones
| Issue | Delivered outcome | Open successor |
|---|---|---|
| #4253 | Package-cost measurement, reachability foundation, baselines, and advisory reporting | #4341 |
| #4254 | Legacy Windows Jest Storybook harness retired | #4347 |
| #4255 | Native accessibility assertion and story-test foundation | #4343, #4346 |
| #4256 | macOS/Windows/Win32 native E2E Storybook pipelines | #4349 (#4342 since closed) |
| #4257 | Source-built real-platform native providers and integration | #4345 |
| #4258 | Public Desktop Driver and shared orchestration landed on main | #4345 |
| #4259 | Maintained Win32 Paper Storybook endpoint | #4344, #4349 |
| #4260 | Native Windows Composition window/element capture | #4348 |
| #4279 | Initial desktop Storybook pipeline foundation | #4349 |
| #4342 | All-skipped WDIO selections are no longer reported as completed coverage (#4464) | #4349 (outcome classification) |
Beta exit criteria
- Public Desktop Driver and shared Storybook CLI are merged and included in repository build/test integration.
- macOS, Windows Fabric, and Win32 Paper PR jobs explicitly build/verify helpers, run native
stories-and-tests, and retain diagnostics. - Authored semantic cases actually execute through each native provider without a fake fallback.
- Authored discovery extends beyond the initial Button/Checkbox/Input foundation.
- Cross-platform package-code measurements and tested optional-module boundaries are reproducible and advisory reports are published.
- Complete portable accessibility role/name/state/value and keyboard coverage on authoritative endpoints (Infrastructure: Complete portable Storybook accessibility coverage and reporting #4343/Infrastructure: Fix native accessibility-state projection gaps on macOS and Win32 #4346).
- Preserve all original delayed focus-survival and movement coverage in active native CI (Infrastructure: Restore Windows Storybook focus-regression parity #4347/Infrastructure: Restore Storybook stories excluded by native desktop crashes #4344).
- Eliminate the all-skipped success path and distinguish product, app, helper, authority, infrastructure, and coverage outcomes (Infrastructure: Reject all-skipped WDIO runs as completed coverage #4342/Infrastructure: Qualify and require native Storybook CI coverage #4349). The all-skipped path is fixed (Infrastructure: Reject all-skipped WDIO runs as completed coverage #4342 closed via Desktop testing: declare and select WDIO cases by input lane, platform and scope #4464); outcome classification remains in Infrastructure: Qualify and require native Storybook CI coverage #4349.
Production exit criteria
- All required authored cohorts run on authoritative macOS/Windows/Win32 environments with auditable callback/catalog/helper/app identity (Infrastructure: Qualify and require native Storybook CI coverage #4349).
- Retry/quarantine/expiry, retention/redaction/access, escalation, fork safety, and runner capacity have named owners (Infrastructure: Qualify and require native Storybook CI coverage #4349).
- At least 100 representative runs per endpoint over 14 days meet at least 99% infrastructure success, with zero leaked processes or unreleased input and complete failure metadata (Infrastructure: Qualify and require native Storybook CI coverage #4349/Infrastructure: Complete Desktop Driver production release qualification #4345).
- Desktop Driver passes its remaining compatibility, authority, security, cache, performance, packaging, external-consumer, and publishing gates (Infrastructure: Complete Desktop Driver production release qualification #4345).
- Package-cost/dependency gates are required, measurement coverage is complete, and increases require reviewed rationale (Infrastructure: Enforce package-cost budgets and production dependency boundaries #4341).
- Native accessibility and restored regression coverage are required without counting skips/quarantine as passes (Infrastructure: Complete portable Storybook accessibility coverage and reporting #4343/Infrastructure: Restore Windows Storybook focus-regression parity #4347).
- Windows/Win32 publish qualified capture evidence with provenance and truthful locked-session diagnostics (Infrastructure: Qualify Windows/Win32 capture fidelity and provenance #4348).
- Native visual comparison pilots/reports are delivered on all three endpoints; pixel changes remain advisory (Infrastructure: Add native Storybook visual comparison reports for Windows, Win32, and macOS #4328).
Evidence and operating boundaries
- Public driver delivery #4294, native providers #4306, WDIO #4313, focus/accessibility #4314, and bundle measurement #4335.
- Desktop driver program (Infrastructure: Desktop driver improvements for workload hosting, lifecycle, and agent orchestration #4435):
- Foundation: Desktop driver: bounded agent operations, protected service, and MCP adapter #4434
- F1: Unify desktop driver-service composition and wire durable recovery #4455
- F2-F5: Desktop driver: typed resources, process lifelines, story lifetimes, exclusive agent ingress, and native qualification runbook #4463
- Input lanes: Desktop testing: declare and select WDIO cases by input lane, platform and scope #4464 and Desktop testing: migrate stories and split CI input lanes #4466
- F16: Desktop testing: enforce session input policy #4468
- Windows ownership and physical input: Qualify Windows desktop-driver ownership and physical input #4469
- Logging: Improve desktop-test and storybook-desktop logging output #4470
- Manifest provenance, attach-only handoff, application ownership and native qualification: Tighten Storybook manifest provenance and credential isolation #4490-feat(desktop-test): qualify Windows application ownership and containment #4494, Select desktop stories directly and attribute per-case E2E time #4496 and fix: qualify Windows activation and Win32 secondary content windows #4498-Fix macOS physical-input postconditions and add an advisory physical CI lane #4500
- Package status:
desktop-testcurrent status
- Native-core modernization: Modernize native-core desktop primitives and track remaining qualification #4381.
- PR workflow, CI authority model, remaining driver work, platform discovery, and bundle fixture.
- Windows retained native reports and Win32 retained native reports substantiate both the executed/skipped cohort and the all-skipped per-story report bug.
- Fake runs prove contracts only; render traversal proves renderability only. Hosted skips do not qualify input, TCC, DPI, or native accessibility gaps.
- Interactive Windows qualification requires a logged-in unlocked desktop; authoritative macOS qualification requires a managed Aqua session, stable signer, and explicit privacy authority.
Activity
main#4258JasonVMo commentedon Oct 16, 2026
Native-core modernization follow-ups are now filed under the appropriate workstreams. Direct infrastructure children: #4376 (Win32 capability evidence, old peer floors, packed consumers, publishing, and root admission) and #4380 (real-consumer TurboModule qualification, deferred until justified). Component behavior/qualification is under #4274 as #4374, #4375, #4377, #4378, and #4379. Existing driver/CI/accessibility follow-ups #4343, #4345, #4346, #4347, and #4349 remain open; this migration does not claim production/root qualification.
JasonVMo commentedon Nov 19, 2026
Desktop automation preview under #4435: #4515 contains the source release fixes and the reproducible package and native qualification evidence. The changed physical Input story passed on all four endpoints. Full Win32 mixed-service crash recovery remains a separate follow-up in #4441; the preview leaves the existing fence intact. The source PR does not merge or publish the versioned packages; the regenerated #4509 and post-publish checks are separate.