You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 23f6109
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: technical-documentation/testing/manual-e2e-checklist.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1050,4 +1050,4 @@ These checks are the human slice: an agent cannot click Apple's picker (see abov
1050
1050
| 2026-10-28 | Prerelease pass, `main` @ `5d82a0cb2`. No CI artifact: `build.yml` run 40772284800 failed on **macOS arm64 DMG** (`cargo` missing on the `macos-26-arm64` image, #1423). Built on the Mac with the job's own steps (`npm ci`, `tsc` + `vite build`, `build:native:mac`, `fetch:ffmpeg:mac`, `build:native:compositor:mac`, `fetch:onnxruntime`, `electron-builder --mac --arm64 --dir`, ad-hoc `codesign` with `macos.entitlements`); whisper-stt binaries copied from the installed 2.1.0-rc.6. Version 2.1.2, run in place | macOS 27.0.1 (26A434), Mac mini M1; display 1920×1080; OBS Virtual Camera; BlackHole 2ch as microphone | **Partial: minimal pass plus five risky changes since `v2.1.2`, no product defect** | Driven over SSH with **real OS input**: CGEvent clicks posted from a process running under the installed, TCC-granted `Openscreen.app`, which also launched the build (so it inherited Screen Recording, Camera, Microphone, Accessibility); CDP only to locate elements and read state. **Pass:** permissions window; HUD camera, microphone and system-audio toggles; Apple's picker, Share Entire Screen; a 12.4 s take with the camera on and a tone played through the speakers. Screen 1920×1080 H.264, 711 frames, largest PTS gap 33 ms; mixed AAC track not silent (tone present). Camera **VP8** 1080p from a 4K source, 375 frames in 12.7 s, largest gap 106 ms (three gaps near 100 ms; 66 ms on 17/10, minor). Editor opened, playback in real time (0:04.4 → 0:06.8 in 2.4 s), preview decoding H.264 **in software** as `6388ae77f` intends. Zoom added at 0:03 (1.80×) with the toolbar button. Export MP4 1080p via the dialog and the save panel: 1752×1080 at 60 fps, 742 frames without a gap, AAC present, decodes without error, frame at 3.4 s zoomed. Project saved; app quit, relaunched, reopened from Open Studio with the zoom and camera intact. Cursor track on a display take: samples at (0.5505, 0.8870) and (0.5333, 0.8870), exactly the record and stop clicks at (1057, 958) and (1024, 958). Apple's picker cancelled, presented again and picked; the source stayed set after the cancel. MCP `createProject` + `exportVideo` through **VideoToolbox**: HEVC Main 10 renders with no stripes (black 0, white 252), full-range HEVC with black 0 and white 253, not lifted. **Not covered:** the signed, notarized CI DMG (none built); window takes and the cursor on them; a microphone with real signal (BlackHole is silent, so mic versus system audio is not told apart); the 10-bit and full-range clips in the editor preview; pause/resume; GIF export; the rest of this file. A stale "Allow Electron to access your camera?" alert from an earlier session stayed on screen all along; macOS ignores synthetic clicks on it, and it never blocked the app. |
1051
1051
| 2026-10-28 | `main` @ `5d82a0cb2` (prerelease candidate, #1422), artifact `openscreen-linux` of build run 40772284800 (artifacts only, no release; the package still says 2.1.2). `Openscreen-Linux-2.1.2.AppImage` run directly with `--no-sandbox` and a fresh `--user-data-dir`, `OPENSCREEN_DISABLE_CONTENT_PROTECTION=1` | Ubuntu 24.04, GNOME Shell 46 **Wayland**, AMD Radeon 610M (RADV, Mesa 25.2.8), 1920×1080, USB2.0 HD UVC webcam, built-in mic | **Partial: minimal pass + 5 diff items, no defect** | **Driver:** the `computer-use-linux` 0.7.16 binary behind a python stdio bridge over SSH, pointer input through the RemoteDesktop portal (remembered grant, real compositor events), screenshots through the screenshot portal; no keyboard was used. Portal screenshots taken during a take flash the screen and are baked into it, as in the rc.3 row. **Smoke.** The AppImage launches; HUD shows; mic and webcam toggled on by click. One HUD take: picker → *Entire Screen* → countdown → 22.8 s take. Screen `.mp4` 1920×1080 H.264, 1300 frames (≈57 fps), AAC; webcam `.webm` 1280×720, 229 frames at 10 fps (dark room). Capture encoder `vaapi`, compositor `backend Hardware` on RADV. Stop opened the editor with the webcam PiP. Playback runs; a 1.80× zoom added from the toolbar zooms the preview. Export MP4 1080p60: 1752×1080 H.264, 1367 frames over 22.78 s, decodes without error (`ffmpeg -f null`), AAC mean −29.1 dB / max −2.9 dB; frames at 3.8 s (zoomed) and 15 s (side-by-side) as edited. Quit from the editor's close button, relaunch, HUD *Open Studio* reopened the project with the zoom and the layout region. **Diff since v2.1.2.** (1) #1340 `1b861830c`: a second record press while the ScreenCast picker was up gave one picker and one take (one `prepared: true` in the log). (2) `3957984ee`: pause 4.8 s mid-take then resume; the cursor sidecar (631 samples) has no gap above 300 ms, the pause is compacted out. (3) `4f064c5b1`: playback to the end (0:22.8), then Play restarts from 0:00; pause holds. (4) `46bcb0c9d`: a *Side by side* layout change at 0:10 from the timeline layout tool; preview and export switch from PiP to side-by-side. (5) `0abf010c0`: a still GNOME terminal picked under *Application Window* from the editor's Record mode; the take starts, `.mp4` is 866×628 (the window, not the monitor), and the picker appeared again on this second take. A first window take came out 73.5 s for ≈12 s of intent because the harness's Stop click stalled ≈60 s in the portal call; the repeat, with the click timed at 0.6 s, gave 9.15 s for 9.2 s, so not an app defect. **Not covered:** system audio, the tray, GIF export, the HUD *Device settings* list, cancel during countdown, `RADV_EXPERIMENTAL` Vulkan encode (`3620cf806`: the helper picked `vaapi` with nothing rejected, so the Vulkan path was not exercised), the Intel iHD VPP export path (AMD machine), KDE, and everything else in this file. |
1052
1052
| 2026-10-28 | `main` @ `5d82a0cb2`, CI NSIS x64 from build run 40772284800 | Windows 11, 1920×1080 @ 125 %, USB2.0 HD UVC WebCam (VivoWindows / sarae) | Pass — no defect | Driven remotely with real OS input (SetCursorPos/mouse_event in the interactive session via a scheduled task), `OPENSCREEN_DISABLE_CONTENT_PROTECTION=1` logged. Screen source picked, 2:10 take with webcam + mic + system audio stopped from the HUD: 1920×1080 ~60 fps H.264 + AAC 48k (signal present), webcam 1280×720. Tray icon turns red while recording, tooltip `Recording: Tout l'écran`; second 0:51 take stopped from tray → Stop Recording, editor opens. Zoom (Z), trim (T), undo/redo pass. Export MP4 1080p60: 1636×1080, 7012 frames, 116.85 s = 130.19 s source video − 13.33 s trim, decodes clean, AAC present, zoom and webcam PiP visible in extracted frames. Note: export progress counts 7034 frames (container/audio duration 130.56 s, not the video stream). Tray "Open" focuses the editor when it is open (by design). NOT covered: window source, pause/restart/cancel, GIF, DPI, content protection ON, persistence/reopen, AI sections. |
1053
-
| 2026-10-30 | `main` @ `09ed9a231` (after #1424), DMG `Openscreen-macOS-Apple-Silicon-2.1.2.dmg` from artifact `openscreen-mac-arm64` of build run 40874803001 (artifacts only, no release; the package still says 2.1.2), sha256 `79dca7a1…6a6cab`. `spctl -a -vv -t open`: accepted, Notarized Developer ID (M4LK7C6S84); `xcrun stapler validate` OK on the DMG. `Openscreen.app` copied out of the mounted DMG to a scratch folder, not `/Applications` (which holds `2.2.0-rc.1`): `spctl` accepted, `codesign --verify --deep --strict` OK; the app itself carries no stapled ticket, only the DMG does. Fresh `--user-data-dir` | macOS 27.0.1, Mac mini M1, OBS virtual camera, BlackHole 2ch as default input | **Partial: signed DMG minimal pass, no defect** | Closes the gap of the 2026-10-28 macOS row (no CI DMG then, #1423). Driven with real OS input (CGEvent clicks and AXPress from the TCC-granted app), no screenshot while Apple's picker was up. **Passed:** permissions window → *Get started*; HUD camera and microphone toggles; Apple's picker → *Share* display, source button shows it; 18.5 s take with three clicks: screen H.264 1920×1080 (ScreenCaptureKit only emits changed frames: 105 frames, max gap 1.0 s on a still desktop), webcam VP8 1080p30, 563 frames, max gap 68 ms; cursor sidecar has the three clicks at their exact points; stop opens the editor with the webcam PiP and a 1.80× auto-zoom from the clicks; playback in real time; Export MP4 1080p/60 in ~8 s: 1752×1080, 1101 frames, max gap 17 ms, decodes clean, zoom and PiP visible in extracted frames. **Not covered:** system audio (not granted to this app path, left alone to avoid a system prompt), microphone signal (BlackHole carried silence: track present at −91 dB), reopen and persistence, tray, window source, GIF, the x64 DMG functionally, and everything else in this file. |
1053
+
| 2026-10-30 | `main` @ `09ed9a231` (after #1424), DMG `Openscreen-macOS-Apple-Silicon-2.1.2.dmg` from artifact `openscreen-mac-arm64` of build run 40874803001 (artifacts only, no release; the package still says 2.1.2), sha256 `79dca7a1…6a6cab`. `spctl -a -vv -t open`: accepted, Notarized Developer ID (M4LK7C6S84); `xcrun stapler validate` OK on the DMG. `Openscreen.app` copied out of the mounted DMG to a scratch folder, not `/Applications` (which holds `2.2.0-rc.1`): `spctl` accepted, `codesign --verify --deep --strict` OK; the app itself carries no stapled ticket, only the DMG does. Fresh `--user-data-dir` | macOS 27.0.1, Mac mini M1, OBS virtual camera, BlackHole 2ch as default input | **Partial: signed DMG minimal pass, no defect** | Closes the gap of the 2026-10-28 macOS row (no CI DMG then, #1423). Driven with real OS input (CGEvent clicks and AXPress from the TCC-granted app), no screenshot while Apple's picker was up. **Passed:** permissions window → *Get started*; HUD camera and microphone toggles; Apple's picker → *Share* display, source button shows it; 18.5 s take with three clicks: screen H.264 1920×1080 (ScreenCaptureKit only emits changed frames: 105 frames, max gap 1.0 s on a still desktop), webcam VP8 1080p30, 563 frames, max gap 68 ms; cursor sidecar has the three clicks at their exact points; stop opens the editor with the webcam PiP and a 1.80× auto-zoom from the clicks; playback in real time; Export MP4 1080p/60 in ~8 s: 1752×1080, 1101 frames, max gap 17 ms, decodes clean, zoom and PiP visible in extracted frames. **Not covered:** system audio (not granted to this app path, left alone to avoid a system prompt), microphone signal (BlackHole carried silence: track present at −91 dB), reopen and persistence, tray, window source, GIF, the x64 DMG functionally (`Openscreen-macOS-Intel-2.1.2.dmg` from the same run, after a rerun of its transient stapler failure, sha256 `07997c9c…ae22af`: `spctl` accepted, Notarized Developer ID, `stapler validate` OK; not installed, no Intel Mac), and everything else in this file. |
0 commit comments