Skip to content

Commit d518ee8

Browse files
committed
prerelease 10-07 a3: PR #7505 validation against the campaign's repros (0 storms, race triggered every run)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SjCrbdguMkfe4bhbaREiwo
1 parent 5a8c6ed commit d518ee8

19 files changed

Lines changed: 146 additions & 0 deletions
Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
# Validation of reflex-dev/reflex#7505 (A3-11 / A3-12 fix, branch `claude/a3-11-storage-echo`)
2+
3+
Runs the campaign's own reproductions against the PR branch (worktree `/home/user/wt-a3-11`, reflex and reflex-base editable from it,
4+
venv symlinked as `$SB/envs/a311fix`), with the published 0.10.0a3 (`$SB/envs/a3`) as the control. The apps are copies of
5+
`a3_hydration/src/{bootecho,syncstamp}` and `a3_hydration/verification/src/vhsync` whose venv guard is changed to the worktree path.
6+
7+
| scenario | published 0.10.0a3 | PR branch |
8+
|---|---|---|
9+
| explorer storm (`sync_race.py` Part S: tab0 changes a synced var 5x while 6 tabs load), dev | 3/4 storm (48k–61k frames, never converge) | 0/11 storm, all converge on s5 (65–81 frames) |
10+
| same, prod | 2/5 (campaign) | 0/7 storm, all converge |
11+
| explorer `stamp_storm.py /stamp 6` (A3-12), dev | 4/4 storm (330k–478k frames) | 0/6 storm, 6/6 converge |
12+
| same, 3 tabs, dev | storms (campaign) | 0/6 storm, 6/6 converge |
13+
| same, 6 tabs, prod | — | 0/4 storm, 4/4 converge |
14+
| verifier raw CDP, 3 restored background tabs, one click, 100 ms RTT | 3/3 storm (verifier) | 0/3 storm; race triggered 3/3 (`vtrigger.txt`) |
15+
| verifier restore 7 tabs + click, 100 ms RTT | storm whenever triggered | 0/4 storm; race triggered 4/4 |
16+
| verifier 6 restored background tabs on stamping pages (A3-12) | 2/2 storm | 0/2 |
17+
| verifier 4 stamping tabs + dev backend reload (A3-12) | 2/2 storm | 0/2 |
18+
19+
Rerun: `scripts/matrix.sh` (explorer drivers, ports 3150/3151, 8150/8151) and `scripts/vh_matrix.sh` (verifier drivers, 100 ms RTT
20+
proxy, ports 3660/8660/8661). Results: `results/final_matrix.txt`, `results/fix_*.json`, `results/vtrigger.txt`.
Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
fix dev n=6 run 1: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 90, "finals": ["edc6e7-1", "edc6e7-1", "edc6e7-1", "edc6e7-1", "edc6e7-1", "edc6e7-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
2+
fix dev n=6 run 2: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 90, "finals": ["6de4ec-1", "6de4ec-1", "6de4ec-1", "6de4ec-1", "6de4ec-1", "6de4ec-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
3+
fix dev n=6 run 3: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 107, "finals": ["af3b3c-1", "af3b3c-1", "af3b3c-1", "af3b3c-1", "af3b3c-1", "af3b3c-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
4+
fix dev n=6 run 4: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 100, "finals": ["a12eb7-1", "a12eb7-1", "a12eb7-1", "a12eb7-1", "a12eb7-1", "a12eb7-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
5+
fix dev n=6 run 5: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 101, "finals": ["2316ff-1", "2316ff-1", "2316ff-1", "2316ff-1", "2316ff-1", "2316ff-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
6+
fix dev n=6 run 6: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 113, "finals": ["6aafe3-1", "6aafe3-1", "6aafe3-1", "6aafe3-1", "6aafe3-1", "6aafe3-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
7+
fix dev n=3 run 1: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 43, "finals": ["3fb1d7-1", "3fb1d7-1", "3fb1d7-1"], "storage_events": [2, 2, 2]}
8+
fix dev n=3 run 2: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 37, "finals": ["5c8087-1", "5c8087-1", "5c8087-1"], "storage_events": [2, 2, 2]}
9+
fix dev n=3 run 3: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 36, "finals": ["441ec2-1", "441ec2-1", "441ec2-1"], "storage_events": [2, 2, 2]}
10+
fix dev n=3 run 4: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 37, "finals": ["76a47b-1", "76a47b-1", "76a47b-1"], "storage_events": [2, 2, 2]}
11+
fix dev n=3 run 5: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 40, "finals": ["71466b-1", "71466b-1", "71466b-1"], "storage_events": [2, 2, 2]}
12+
fix dev n=3 run 6: {"path": "/stamp", "n": 3, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 37, "finals": ["f12257-1", "f12257-1", "f12257-1"], "storage_events": [2, 2, 2]}
13+
fix prod n=6 run 1: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 111, "finals": ["e9a143-1", "e9a143-1", "e9a143-1", "e9a143-1", "e9a143-1", "e9a143-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
14+
fix prod n=6 run 2: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 105, "finals": ["2120d5-1", "2120d5-1", "2120d5-1", "2120d5-1", "2120d5-1", "2120d5-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
15+
fix prod n=6 run 3: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 83, "finals": ["f0f66a-1", "f0f66a-1", "f0f66a-1", "f0f66a-1", "f0f66a-1", "f0f66a-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
16+
fix prod n=6 run 4: {"path": "/stamp", "n": 6, "converged": true, "storm": false, "windows_5s": [0, 0], "frames_total": 94, "finals": ["c58a55-1", "c58a55-1", "c58a55-1", "c58a55-1", "c58a55-1", "c58a55-1"], "storage_events": [5, 5, 5, 5, 5, 5]}
17+
--- fix dev run 1
18+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 3, "t2": 3, "t3": 3, "t4": 3, "t5": 2, "t6": 3}, "frames_total": 81, "frames_in_quiet_2s": 0, "converged": true}
19+
--- fix dev run 2
20+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 3, "t2": 3, "t3": 2, "t4": 3, "t5": 2, "t6": 2}, "frames_total": 77, "frames_in_quiet_2s": 0, "converged": true}
21+
--- fix dev run 3
22+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 3, "t2": 3, "t3": 3, "t4": 2, "t5": 2, "t6": 2}, "frames_total": 77, "frames_in_quiet_2s": 0, "converged": true}
23+
--- fix dev run 4
24+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 3, "t2": 4, "t3": 3, "t4": 2, "t5": 2, "t6": 3}, "frames_total": 81, "frames_in_quiet_2s": 0, "converged": true}
25+
--- fix dev run 5
26+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 2, "t2": 2, "t3": 3, "t4": 2, "t5": 2, "t6": 3}, "frames_total": 75, "frames_in_quiet_2s": 0, "converged": true}
27+
--- fix prod run 1
28+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 4, "t2": 4, "t3": 4, "t4": 4, "t5": 4, "t6": 4}, "frames_total": 95, "frames_in_quiet_2s": 0, "converged": true}
29+
--- fix prod run 2
30+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 4, "t2": 4, "t3": 4, "t4": 4, "t5": 5, "t6": 4}, "frames_total": 97, "frames_in_quiet_2s": 0, "converged": true}
31+
--- fix prod run 3
32+
S: {"observe_windows_5s": [], "finals": {"t0": "s5", "t1": "s5", "t2": "s5", "t3": "s5", "t4": "s5", "t5": "s5", "t6": "s5"}, "ls_final": "s5", "storage_events_per_tab": {"t0": 0, "t1": 5, "t2": 5, "t3": 5, "t4": 5, "t5": 5, "t6": 5}, "uvi_per_tab": {"t0": 0, "t1": 4, "t2": 4, "t3": 4, "t4": 4, "t5": 4, "t6": 4}, "frames_total": 95, "frames_in_quiet_2s": 0, "converged": true}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"scenario": "docs-restart", "clicks": [], "windows_5s": [0, 8, 0], "storm": false, "theme_final": ["green", "green", "green", "green"], "doc_final": ["d2", "d2", "d2", "d2"], "converged": true, "ls_theme": "green", "ls_doc": "d2", "visibility": ["visible", "visible", "visible", "visible"], "tab0_timeline": ["light", "green"]}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"scenario": "docs-restart", "clicks": [], "windows_5s": [0, 8, 0], "storm": false, "theme_final": ["green", "green", "green", "green"], "doc_final": ["d1", "d1", "d1", "d1"], "converged": true, "ls_theme": "green", "ls_doc": "d1", "visibility": ["visible", "visible", "visible", "visible"], "tab0_timeline": ["light", "green"]}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"visibility": ["visible", "hidden", "hidden"], "windows_5s": [0, 0], "storm": false, "theme_final": ["red", "red", "red"], "doc_final": ["", "", ""], "converged": true, "ls_doc": null, "ls_theme": "red"}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"visibility": ["visible", "hidden", "hidden"], "windows_5s": [0, 0], "storm": false, "theme_final": ["red", "red", "red"], "doc_final": ["", "", ""], "converged": true, "ls_doc": null, "ls_theme": "red"}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"visibility": ["visible", "hidden", "hidden"], "windows_5s": [0, 0], "storm": false, "theme_final": ["red", "red", "red"], "doc_final": ["", "", ""], "converged": true, "ls_doc": null, "ls_theme": "red"}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"visibility": ["visible", "hidden", "hidden", "hidden", "hidden", "hidden"], "windows_5s": [0, 0], "storm": false, "theme_final": ["green", "green", "green", "green", "green", "green"], "doc_final": ["d2", "d2", "d2", "d2", "d2", "d2"], "converged": true, "ls_doc": "d2", "ls_theme": "green"}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"visibility": ["visible", "hidden", "hidden", "hidden", "hidden", "hidden"], "windows_5s": [0, 0], "storm": false, "theme_final": ["green", "green", "green", "green", "green", "green"], "doc_final": ["d1", "d1", "d1", "d1", "d1", "d1"], "converged": true, "ls_doc": "d1", "ls_theme": "green"}
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"scenario": "restore", "clicks": [["pick-red", 1791415217.481, 0.018]], "windows_5s": [0, 0], "storm": false, "theme_final": ["red", "red", "red", "red", "red", "red", "red"], "doc_final": ["warm", "warm", "warm", "warm", "warm", "warm", "warm"], "converged": true, "ls_theme": "red", "ls_doc": "warm", "visibility": ["visible", "visible", "visible", "visible", "visible", "visible", "visible"], "tab0_timeline": ["light", "green", "red"]}

0 commit comments

Comments
 (0)