Skip to content

Commit af2ad51

Browse files
committed
docs(polyfill): record verified conformance results
Keep the coverage counts and platform limitations tied to the recorded runs. Record Safari's incomplete 185/190-subtest run and its WebDriver cleanup failure so the documentation does not imply that the full suite completed. The input-conversion implementation is unchanged; its preceding review passed 226 browser tests.
1 parent aa24dcd commit af2ad51

1 file changed

Lines changed: 8 additions & 7 deletions

File tree

‎TESTING.md‎

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -2,13 +2,13 @@
22

33
## Results
44

5-
**223 browser tests pass** across Chromium 153.0.8010.12, Firefox 155.0, and
5+
**226 browser tests pass** across Chromium 153.0.8010.12, Firefox 155.0, and
66
Playwright WebKit 26.6. Package checks also pass: imports, types, SSR, and tarball contents.
77
CI runs these checks plus WPT in Chrome, Firefox, and actual Safari. Safari runs on
88
`macos-26`; Playwright WebKit is a separate build.
99

1010
WPT covers **all 70 WebMCP testharness files, 190 subtests**, with zero unexpected results
11-
in Chrome and Firefox:
11+
in Chrome, Firefox, and Safari:
1212

1313
| Subtest result | Count |
1414
| --- | ---: |
@@ -17,9 +17,10 @@ in Chrome and Firefox:
1717
| Expected TIMEOUT | 26 |
1818
| Expected NOTRUN | 20 |
1919

20-
Tested with Chrome Canary 157.0.8080.0 and Firefox Nightly 159.0a1 (20260930214513).
21-
Safari has not yet run at this pin; none of the expectations are browser-specific.
22-
At the file level: 43 OK, 26 expected timeouts, one expected error.
20+
The [CI run for PR #8](https://github.com/webmachinelearning/webmcp-polyfill/actions/runs/36969192728)
21+
used Chrome Canary 157.0.8081.0, Firefox Nightly 159.0a1, and Safari 26.6.2
22+
(21624.5.1.11.3). All three have the counts above; none of the expectations are
23+
browser-specific. At the file level: 43 OK, 26 expected timeouts, one expected error.
2324

2425
Expected failures are still failures. `NOTRUN` means an earlier timeout prevented
2526
the test from running, including three abort cases. Passing declarative checks only
@@ -71,8 +72,8 @@ and `webmcp-types@0.1.9`.
7172
- **Missing APIs:** declarative forms, CSS states, and lifecycle events
7273
(`toolactivated`/`toolcancel`, their handlers, and `ToolActivatedEvent`/`ToolCancelEvent`)
7374
are not implemented.
74-
- **Draft differences:** results are JSON-serialized; some pinned tests expect raw
75-
strings.
75+
- **Pinned WPT differences:** results are JSON-serialized as the draft requires;
76+
some pinned tests expect raw strings.
7677
- **Timing:** MessagePorts approximate native task ordering. Aborting before
7778
dispatch skips the callback; the draft dispatches and then aborts its signal.
7879
Delegated permission checks are asynchronous, so argument errors can precede

0 commit comments

Comments
 (0)