Skip to content

Commit 23f6109

Browse files
committed
docs(testing): add the x64 DMG signature check
Refs #1422
1 parent 4a980fe commit 23f6109

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎technical-documentation/testing/manual-e2e-checklist.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1050,4 +1050,4 @@ These checks are the human slice: an agent cannot click Apple's picker (see abov
10501050
| 2026-10-28 | Prerelease pass, `main` @ `5d82a0cb2`. No CI artifact: `build.yml` run 40772284800 failed on **macOS arm64 DMG** (`cargo` missing on the `macos-26-arm64` image, #1423). Built on the Mac with the job's own steps (`npm ci`, `tsc` + `vite build`, `build:native:mac`, `fetch:ffmpeg:mac`, `build:native:compositor:mac`, `fetch:onnxruntime`, `electron-builder --mac --arm64 --dir`, ad-hoc `codesign` with `macos.entitlements`); whisper-stt binaries copied from the installed 2.1.0-rc.6. Version 2.1.2, run in place | macOS 27.0.1 (26A434), Mac mini M1; display 1920×1080; OBS Virtual Camera; BlackHole 2ch as microphone | **Partial: minimal pass plus five risky changes since `v2.1.2`, no product defect** | Driven over SSH with **real OS input**: CGEvent clicks posted from a process running under the installed, TCC-granted `Openscreen.app`, which also launched the build (so it inherited Screen Recording, Camera, Microphone, Accessibility); CDP only to locate elements and read state. **Pass:** permissions window; HUD camera, microphone and system-audio toggles; Apple's picker, Share Entire Screen; a 12.4 s take with the camera on and a tone played through the speakers. Screen 1920×1080 H.264, 711 frames, largest PTS gap 33 ms; mixed AAC track not silent (tone present). Camera **VP8** 1080p from a 4K source, 375 frames in 12.7 s, largest gap 106 ms (three gaps near 100 ms; 66 ms on 17/10, minor). Editor opened, playback in real time (0:04.4 → 0:06.8 in 2.4 s), preview decoding H.264 **in software** as `6388ae77f` intends. Zoom added at 0:03 (1.80×) with the toolbar button. Export MP4 1080p via the dialog and the save panel: 1752×1080 at 60 fps, 742 frames without a gap, AAC present, decodes without error, frame at 3.4 s zoomed. Project saved; app quit, relaunched, reopened from Open Studio with the zoom and camera intact. Cursor track on a display take: samples at (0.5505, 0.8870) and (0.5333, 0.8870), exactly the record and stop clicks at (1057, 958) and (1024, 958). Apple's picker cancelled, presented again and picked; the source stayed set after the cancel. MCP `createProject` + `exportVideo` through **VideoToolbox**: HEVC Main 10 renders with no stripes (black 0, white 252), full-range HEVC with black 0 and white 253, not lifted. **Not covered:** the signed, notarized CI DMG (none built); window takes and the cursor on them; a microphone with real signal (BlackHole is silent, so mic versus system audio is not told apart); the 10-bit and full-range clips in the editor preview; pause/resume; GIF export; the rest of this file. A stale "Allow Electron to access your camera?" alert from an earlier session stayed on screen all along; macOS ignores synthetic clicks on it, and it never blocked the app. |
10511051
| 2026-10-28 | `main` @ `5d82a0cb2` (prerelease candidate, #1422), artifact `openscreen-linux` of build run 40772284800 (artifacts only, no release; the package still says 2.1.2). `Openscreen-Linux-2.1.2.AppImage` run directly with `--no-sandbox` and a fresh `--user-data-dir`, `OPENSCREEN_DISABLE_CONTENT_PROTECTION=1` | Ubuntu 24.04, GNOME Shell 46 **Wayland**, AMD Radeon 610M (RADV, Mesa 25.2.8), 1920×1080, USB2.0 HD UVC webcam, built-in mic | **Partial: minimal pass + 5 diff items, no defect** | **Driver:** the `computer-use-linux` 0.7.16 binary behind a python stdio bridge over SSH, pointer input through the RemoteDesktop portal (remembered grant, real compositor events), screenshots through the screenshot portal; no keyboard was used. Portal screenshots taken during a take flash the screen and are baked into it, as in the rc.3 row. **Smoke.** The AppImage launches; HUD shows; mic and webcam toggled on by click. One HUD take: picker → *Entire Screen* → countdown → 22.8 s take. Screen `.mp4` 1920×1080 H.264, 1300 frames (≈57 fps), AAC; webcam `.webm` 1280×720, 229 frames at 10 fps (dark room). Capture encoder `vaapi`, compositor `backend Hardware` on RADV. Stop opened the editor with the webcam PiP. Playback runs; a 1.80× zoom added from the toolbar zooms the preview. Export MP4 1080p60: 1752×1080 H.264, 1367 frames over 22.78 s, decodes without error (`ffmpeg -f null`), AAC mean −29.1 dB / max −2.9 dB; frames at 3.8 s (zoomed) and 15 s (side-by-side) as edited. Quit from the editor's close button, relaunch, HUD *Open Studio* reopened the project with the zoom and the layout region. **Diff since v2.1.2.** (1) #1340 `1b861830c`: a second record press while the ScreenCast picker was up gave one picker and one take (one `prepared: true` in the log). (2) `3957984ee`: pause 4.8 s mid-take then resume; the cursor sidecar (631 samples) has no gap above 300 ms, the pause is compacted out. (3) `4f064c5b1`: playback to the end (0:22.8), then Play restarts from 0:00; pause holds. (4) `46bcb0c9d`: a *Side by side* layout change at 0:10 from the timeline layout tool; preview and export switch from PiP to side-by-side. (5) `0abf010c0`: a still GNOME terminal picked under *Application Window* from the editor's Record mode; the take starts, `.mp4` is 866×628 (the window, not the monitor), and the picker appeared again on this second take. A first window take came out 73.5 s for ≈12 s of intent because the harness's Stop click stalled ≈60 s in the portal call; the repeat, with the click timed at 0.6 s, gave 9.15 s for 9.2 s, so not an app defect. **Not covered:** system audio, the tray, GIF export, the HUD *Device settings* list, cancel during countdown, `RADV_EXPERIMENTAL` Vulkan encode (`3620cf806`: the helper picked `vaapi` with nothing rejected, so the Vulkan path was not exercised), the Intel iHD VPP export path (AMD machine), KDE, and everything else in this file. |
10521052
| 2026-10-28 | `main` @ `5d82a0cb2`, CI NSIS x64 from build run 40772284800 | Windows 11, 1920×1080 @ 125 %, USB2.0 HD UVC WebCam (VivoWindows / sarae) | Pass — no defect | Driven remotely with real OS input (SetCursorPos/mouse_event in the interactive session via a scheduled task), `OPENSCREEN_DISABLE_CONTENT_PROTECTION=1` logged. Screen source picked, 2:10 take with webcam + mic + system audio stopped from the HUD: 1920×1080 ~60 fps H.264 + AAC 48k (signal present), webcam 1280×720. Tray icon turns red while recording, tooltip `Recording: Tout l'écran`; second 0:51 take stopped from tray → Stop Recording, editor opens. Zoom (Z), trim (T), undo/redo pass. Export MP4 1080p60: 1636×1080, 7012 frames, 116.85 s = 130.19 s source video − 13.33 s trim, decodes clean, AAC present, zoom and webcam PiP visible in extracted frames. Note: export progress counts 7034 frames (container/audio duration 130.56 s, not the video stream). Tray "Open" focuses the editor when it is open (by design). NOT covered: window source, pause/restart/cancel, GIF, DPI, content protection ON, persistence/reopen, AI sections. |
1053-
| 2026-10-30 | `main` @ `09ed9a231` (after #1424), DMG `Openscreen-macOS-Apple-Silicon-2.1.2.dmg` from artifact `openscreen-mac-arm64` of build run 40874803001 (artifacts only, no release; the package still says 2.1.2), sha256 `79dca7a1…6a6cab`. `spctl -a -vv -t open`: accepted, Notarized Developer ID (M4LK7C6S84); `xcrun stapler validate` OK on the DMG. `Openscreen.app` copied out of the mounted DMG to a scratch folder, not `/Applications` (which holds `2.2.0-rc.1`): `spctl` accepted, `codesign --verify --deep --strict` OK; the app itself carries no stapled ticket, only the DMG does. Fresh `--user-data-dir` | macOS 27.0.1, Mac mini M1, OBS virtual camera, BlackHole 2ch as default input | **Partial: signed DMG minimal pass, no defect** | Closes the gap of the 2026-10-28 macOS row (no CI DMG then, #1423). Driven with real OS input (CGEvent clicks and AXPress from the TCC-granted app), no screenshot while Apple's picker was up. **Passed:** permissions window → *Get started*; HUD camera and microphone toggles; Apple's picker → *Share* display, source button shows it; 18.5 s take with three clicks: screen H.264 1920×1080 (ScreenCaptureKit only emits changed frames: 105 frames, max gap 1.0 s on a still desktop), webcam VP8 1080p30, 563 frames, max gap 68 ms; cursor sidecar has the three clicks at their exact points; stop opens the editor with the webcam PiP and a 1.80× auto-zoom from the clicks; playback in real time; Export MP4 1080p/60 in ~8 s: 1752×1080, 1101 frames, max gap 17 ms, decodes clean, zoom and PiP visible in extracted frames. **Not covered:** system audio (not granted to this app path, left alone to avoid a system prompt), microphone signal (BlackHole carried silence: track present at −91 dB), reopen and persistence, tray, window source, GIF, the x64 DMG functionally, and everything else in this file. |
1053+
| 2026-10-30 | `main` @ `09ed9a231` (after #1424), DMG `Openscreen-macOS-Apple-Silicon-2.1.2.dmg` from artifact `openscreen-mac-arm64` of build run 40874803001 (artifacts only, no release; the package still says 2.1.2), sha256 `79dca7a1…6a6cab`. `spctl -a -vv -t open`: accepted, Notarized Developer ID (M4LK7C6S84); `xcrun stapler validate` OK on the DMG. `Openscreen.app` copied out of the mounted DMG to a scratch folder, not `/Applications` (which holds `2.2.0-rc.1`): `spctl` accepted, `codesign --verify --deep --strict` OK; the app itself carries no stapled ticket, only the DMG does. Fresh `--user-data-dir` | macOS 27.0.1, Mac mini M1, OBS virtual camera, BlackHole 2ch as default input | **Partial: signed DMG minimal pass, no defect** | Closes the gap of the 2026-10-28 macOS row (no CI DMG then, #1423). Driven with real OS input (CGEvent clicks and AXPress from the TCC-granted app), no screenshot while Apple's picker was up. **Passed:** permissions window → *Get started*; HUD camera and microphone toggles; Apple's picker → *Share* display, source button shows it; 18.5 s take with three clicks: screen H.264 1920×1080 (ScreenCaptureKit only emits changed frames: 105 frames, max gap 1.0 s on a still desktop), webcam VP8 1080p30, 563 frames, max gap 68 ms; cursor sidecar has the three clicks at their exact points; stop opens the editor with the webcam PiP and a 1.80× auto-zoom from the clicks; playback in real time; Export MP4 1080p/60 in ~8 s: 1752×1080, 1101 frames, max gap 17 ms, decodes clean, zoom and PiP visible in extracted frames. **Not covered:** system audio (not granted to this app path, left alone to avoid a system prompt), microphone signal (BlackHole carried silence: track present at −91 dB), reopen and persistence, tray, window source, GIF, the x64 DMG functionally (`Openscreen-macOS-Intel-2.1.2.dmg` from the same run, after a rerun of its transient stapler failure, sha256 `07997c9c…ae22af`: `spctl` accepted, Notarized Developer ID, `stapler validate` OK; not installed, no Intel Mac), and everything else in this file. |

0 commit comments

Comments
 (0)