@@ -291,3 +291,61 @@ turn but lost DOM snapshot delivery. That intermediate run also used the old
291291stream observer. The passing run is evidence that the corrected scenario works,
292292not a claim that startup/snapshot failures or the original product issue are
293293resolved. Windows CI must pass without retrying or discarding failed samples.
294+
295+ ## Protected live Windows validation prepared (2026-11-06)
296+
297+ The workflow now includes an opt-in ` live-solheim ` job behind Environment
298+ ` solheim ` approval. It tests WebStorm 2026.2.1 with the real Solheim provider,
299+ three fresh two-turn runs, terminal completion markers, required provider tool
300+ names, the actual edited fixture, and preserving-diff log evidence in addition
301+ to exact typing and sampled focus checks. The upstream key is supplied only to
302+ the loopback relay and is removed from the IDE's process environment.
303+
304+ This is prepared test infrastructure, ** not a live-provider PASS** . Hosted
305+ Windows Server remains distinct from the reported Windows 11 environment.
306+ Manual dispatch can select an interactive self-hosted Windows 11 x64 runner;
307+ the runner then validates the OS/architecture. Evidence must be reviewed before
308+ closing #5 . See the harness README for the environment secret and launch steps.
309+
310+ ## Local live Solheim verification (2026-11-06)
311+
312+ ** Accepted live PASS** , 93 seconds, on Linux Xvfb/Openbox with
313+ IU-253.28294.334 (JBR 21.0.8). Endpoint ` https://api.solheim.ai/v1 ` , model
314+ ` qwen3.8-27b ` , real native tool calls through the loopback relay. The plugin is
315+ the artifact built by the passing PR CI run
316+ [ 42154063861] ( https://github.com/Zoo-Code-Org/Zoo-Code-Jetbrains/actions/runs/42154063861 ) ,
317+ ZIP SHA-256
318+ ` edc9bd9634e852a4dbc24e80a8f2baa91320b49f05894c6b457e5c0be7affdb3 ` ,
319+ with the current local harness driver. The smaller connectivity probe separately
320+ returned HTTP 200, streaming events, and an ` attempt_completion ` tool call.
321+
322+ Accepted run evidence: ` /tmp/zoo-solheim-e2e.0Ox96IMb/evidence/p/ ` . All 18
323+ first-turn and five follow-up draft samples matched exactly, with textarea and
324+ browser-window focus preserved. Both turns completed with partial updates during
325+ the typing loops. IDE logs confirm all three requested terminal commands exited
326+ 0, the actual file changed to ` solheim_e2e ` , and the diff opened with
327+ ` preserveFocus=true ` and completed. Observed provider responses returned HTTP
328+ 200 and included ` execute_command ` , ` read_file ` , ` apply_diff ` , and
329+ ` attempt_completion ` . The temporary upstream key file was deleted after relay
330+ startup; the relay was stopped after the run. No upstream credential is recorded
331+ here or in test artifacts.
332+
333+ An earlier local run at ` /tmp/zoo-solheim-e2e.ikw85vsS/evidence/p/ ` reported
334+ PASS after 138 seconds but is ** rejected as insufficient coverage** : the intended
335+ follow-up prompt was not pasted, the preserved first-turn draft was submitted,
336+ and the third command never ran. Its raw PASS is retained, not rewritten. This
337+ exposed a harness defect: accepting a completed ` say ` message before the final
338+ completed-task ask and submitting the next turn without checking native paste.
339+ The driver now waits for the completed-task ask, uses normal native key delays,
340+ verifies exact follow-up input before Enter, and requires approval of all three
341+ expected commands. The accepted run above exercises those corrected checks.
342+
343+ These are temporary local evidence paths. This verifies the live-provider
344+ scenario on Linux, not the new Windows PowerShell runner, WebStorm, or Windows
345+ 11 . The protected Windows job still needs to run before #5 can be evaluated for
346+ closure on its reported environment.
347+
348+ The corrected driver also passed the credential-free local fixture E2E in
349+ 88 seconds using the same downloaded plugin artifact. Both turns streamed,
350+ the exact follow-up prompt was verified, and draft/focus checks passed. Evidence:
351+ ` /tmp/zoo-solheim-e2e.TxEsZADF/evidence/p/ ` .
0 commit comments