Skip to content

termtest: deliver the prompt result before closing the stdin pipe - #7506

Merged
pietern merged 1 commit into
mainfrom
denik/termtest-windows-result-before-close
Nov 12, 2026
Merged

pietern merged 1 commit into
mainfrom
denik/termtest-windows-result-before-close

Conversation

@denik

@denik denik commented Nov 11, 2026

Copy link
Copy Markdown
Contributor

Changes

In termtest.Run, the goroutine running the cmdio call now sends (value, err) on done before it closes the stdin pipe's read end. Before this change it closed the pipe first.

Why

On Windows, bubbletea wraps a non-console input in cancelreader's fallback reader, and that reader cannot cancel a read in progress (Cancel() returns false). After the prompt quits, bubbletea's read loop can still be blocked in ReadFile on the pipe. Go's (*os.File).Close on Windows calls CancelIoEx on pipes, but it does nothing when the read loop hasn't entered ReadFile yet. Close then waits for the outstanding read, which only ends when Term.Close (run in t.Cleanup) closes the write end. That happens only after Result() has given up, so the test fails with cmdio call did not finish in 5s, even though the raw output shows bubbletea already restored the terminal. Whether it fails depends on goroutine scheduling, so on a retry it usually passes.

Sending the result first lets Result() return as soon as the call finishes. Close still closes the write end and waits for the goroutine, so nothing leaks.

Background:

I decided not to raise defaultTimeout, because the wait isn't caused by load: it lasts until cleanup, however long the timeout is.

Tests

  • go test ./libs/cmdio/... ./cmd/auth/ (Linux, also -race -count=5 for cmdiotest); GOOS=windows go vet on the same packages.
  • Windows unit tests in this PR's CI.

Dashboard:

error key failure lines
error/2065 select_baseline_wrap_around_test.go:39: cmdio call did not finish in 5s; raw output: … \u001b[?2004l\u001b[?25h\u001b[?1002l\u001b[?1003l\u001b[?1006l / --- FAIL: TestSelectBaseline_WrapAround (5.05s)

Affected (flaky on Windows, 59 tests), e.g. cmdiotest.TestSelectBaseline_Scroll, cmdiotest.TestPromptBaseline_AltKeyNoop, auth.TestPromptForWorkspaceSelection/id_beyond_first_fifty, auth.TestLoginDeviceCodeNewProfilePromptsForHost.

This PR was opened by an AI agent (harness_auto).

This pull request and its description were written by Isaac.

On Windows, bubbletea cannot cancel a read on a pipe, so closing the read
end could block until the test closed the write end in cleanup, after
Result had already timed out.

Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik added the ai-auto PRs made by AI loops & factories, label Nov 11, 2026
@github-actions github-actions Bot added the test-only-fix PRs that update failing of flaky tests without changing CLI code. label Nov 11, 2026
@denik
denik marked this pull request as ready for review November 11, 2026 20:26
@denik
denik requested review from a team as code owners November 11, 2026 20:26
@denik
denik requested review from parthban-db and rclarey November 11, 2026 20:26
@denik
denik enabled auto-merge November 11, 2026 21:48
@pietern
pietern disabled auto-merge November 12, 2026 07:32
@pietern
pietern enabled auto-merge November 12, 2026 07:32
@denik
denik requested a review from andrewnester November 12, 2026 09:11
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: e6f2326

Run: 43091668028

Env 🔄​flaky 💚​RECOVERED ✅​pass 🙈​skip Time
💚​ aws linux-2core-8gb 1 270 15 6:10
💚​ aws-windows-latest-4core-16gb 1 272 13 4:57
💚​ azure linux-2core-8gb 1 269 15 14:13
💚​ azure-windows-latest-4core-16gb 1 271 13 4:26
💚​ gcp linux-2core-8gb 1 270 15 7:36
🔄​ gcp-windows-latest-4core-16gb 5 1 267 13 32:29
6 interesting tests: 5 flaky, 1 RECOVERED
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🔄​ TestFsCpDirToDirFileNotOverwritten/dbfs_to_local ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
🔄​ TestFsCpDirToDirFileNotOverwritten/local_to_dbfs ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
🔄​ TestFsCpDirToDirFileNotOverwritten/uc-volumes_to_dbfs ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
🔄​ TestFilerReadWrite ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
🔄​ TestFilerReadWrite/dbfs ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
Top 14 slowest tests (at least 2 minutes):
duration env testname
5:18 gcp-windows-latest-4core-16gb TestFilerRecursiveDelete/workspace_files
4:54 aws-windows-latest-4core-16gb TestAccept
4:17 azure-windows-latest-4core-16gb TestAccept
3:46 azure linux-2core-8gb TestAccept
3:45 gcp-windows-latest-4core-16gb TestAccept
3:44 gcp linux-2core-8gb TestAccept
3:18 azure linux-2core-8gb TestImportDirWithOverwriteFlag
3:15 aws linux-2core-8gb TestAccept
3:14 gcp-windows-latest-4core-16gb TestFsCpDirToDirFileNotOverwritten/dbfs_to_dbfs
3:08 gcp-windows-latest-4core-16gb TestFsCpDirToDirFileNotOverwritten/uc-volumes_to_dbfs
2:14 gcp-windows-latest-4core-16gb TestFsCpDirToDirFileNotOverwritten/dbfs_to_local
2:11 gcp-windows-latest-4core-16gb TestFilerRecursiveDelete/dbfs
2:08 gcp-windows-latest-4core-16gb TestFsRmFile/dbfs
2:02 gcp-windows-latest-4core-16gb TestFsCpDir/dbfs_to_dbfs

@pietern
pietern added this pull request to the merge queue Nov 12, 2026
Merged via the queue into main with commit e93a3ff Nov 12, 2026
28 checks passed
@pietern
pietern deleted the denik/termtest-windows-result-before-close branch November 12, 2026 09:40
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: e93a3ff

Run: 43193680652

Env ❌​FAIL 🟨​KNOWN 🤯​MISS 💚​RECOVERED ✅​pass 🙈​skip Time
❌​ aws linux-2core-8gb 45 1 11 1505 1279 314:18
❌​ aws-windows-latest-4core-16gb 47 2 40 9 1385 1304 347:24
❌​ azure linux-2core-8gb 68 1 11 1462 1287 337:19
❌​ azure-windows-latest-4core-16gb 49 83 11 1320 1312 345:42
❌​ gcp linux-2core-8gb 41 1 11 1496 1285 310:41
❌​ gcp-windows-latest-4core-16gb 53 134 11 1272 1310 347:59
268 interesting tests: 158 MISS, 98 FAIL, 9 RECOVERED, 3 KNOWN
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🟨​ TestAccept 🟨​K 🤯​M 🟨​K 🤯​M 🟨​K 🤯​M
🤯​ TestAccept/bundle/apps/job_permissions ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/apps/job_permissions/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/apps/job_permissions/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/config-remote-sync/job_fields ✅​p 🙈​s ❌​F 🙈​s ✅​p 🙈​s
❌​ TestAccept/bundle/config-remote-sync/job_fields/DMS=true ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/deployment/bind/pipelines/recreate ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/deployment/bind/pipelines/recreate/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/declined-deploy ❌​F ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/declined-deploy/DMS=true ❌​F ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/deployment-metadata-change ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/deployment-metadata-change/DMS=true ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/existing-state ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/existing-state/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/multiple-resources ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/multiple-resources/DMS=true ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/record-failure ❌​F ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/record-failure/DMS=true ❌​F ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/dms/stale-plan ✅​p ❌​F ❌​F ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/dms/stale-plan/DMS=true/READPLAN= ✅​p ❌​F ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/dms/stale-plan/DMS=true/READPLAN=1 ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/dms/state-features ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/state-features/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/successful-recreate ✅​p ✅​p ❌​F ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/dms/successful-recreate/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_run.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_depends_on.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_depends_on.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=model.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/invariant/no_drift ✅​p ✅​p ✅​p ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN= ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN= ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
💚​ TestAccept/bundle/resources/apps/lifecycle-started 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
❌​ TestAccept/bundle/resources/clusters/lifecycle-started-toggle ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/generate_inplace ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/generate_inplace/DMS= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/generate_inplace/DMS=true ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/nested-folders ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/nested-folders/DMS=/READPLAN= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/nested-folders/DMS=/READPLAN=1 ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/nested-folders/DMS=true/READPLAN= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/nested-folders/DMS=true/READPLAN=1 ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/serialized-inline ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/serialized-inline/DMS=/READPLAN= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/serialized-inline/DMS=/READPLAN=1 ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/serialized-inline/DMS=true/READPLAN= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/serialized-inline/DMS=true/READPLAN=1 ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/simple ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/dashboards/simple/DMS= ✅​p ✅​p ✅​p 🤯​M ✅​p ✅​p
🤯​ TestAccept/bundle/resources/data_quality_monitors/lifecycle ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/data_quality_monitors/lifecycle/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/data_quality_monitors/lifecycle/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/experiments/basic ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/experiments/basic/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/experiments/basic/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/basic ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/basic/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/order ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/order/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/remote-delete ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/remote-delete/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/uppercase-name ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/feature_specs/uppercase-name/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/features/lifecycle ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/features/lifecycle/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/features/lifecycle/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/change-serialized-space ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/change-serialized-space/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/change-serialized-space/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/parent_path_update ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/parent_path_update/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/parent_path_update/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/recreate_when_gone ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/recreate_when_gone/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/recreate_when_gone/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/simple ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/genie_spaces/simple/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/genie_spaces/simple/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/genie_spaces/version_migration ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/genie_spaces/version_migration/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
❌​ TestAccept/bundle/resources/grants/schemas/all_privileges_manage ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/resources/grants/schemas/all_privileges_manage/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
🤯​ TestAccept/bundle/resources/grants/schemas/empty_array ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/grants/schemas/empty_array/DMS= ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/grants/schemas/empty_array/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/grants/schemas/remove_principal_manage ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/resources/grants/schemas/remove_principal_manage/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F
❌​ TestAccept/bundle/resources/grants/volume_change_name ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/grants/volume_change_name/DMS= ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/jobs/cluster_policy/fixed_addition ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/jobs/cluster_policy/fixed_addition/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/jobs/fail-on-active-runs ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/jobs/fail-on-active-runs/DMS= ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
🤯​ TestAccept/bundle/resources/jobs/fail-on-active-runs/DMS=true ✅​p ✅​p ✅​p ✅​p ✅​p 🤯​M
❌​ TestAccept/bundle/resources/materialization_sets/batch ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/materialization_sets/batch/DMS= ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/materialization_sets/immutable ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/materialization_sets/immutable/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/permissions/jobs/current_can_manage_run ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/permissions/jobs/current_can_manage_run/DMS= ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_branches/update_protected ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_branches/update_ttl/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/recreate ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_databases/recreate/DMS= ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_databases/update ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_databases/update/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/remove_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_pg_settings/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_endpoints/update_suspend_timeout/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/remove_history_retention/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_suspend/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_projects/update_history_retention/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/recreate ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_roles/recreate/DMS=true ✅​p ❌​F ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_roles/update ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/update/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/postgres_roles/update/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
Top 50 slowest tests (at least 2 minutes):
duration env testname
12:56 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
11:11 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
11:10 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
11:10 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
9:59 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:46 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:42 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
9:26 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:23 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:23 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
9:19 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
9:08 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:02 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:51 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
8:36 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:26 gcp-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
8:15 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
8:04 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
8:00 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:56 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:55 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
7:50 gcp-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1
7:47 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:40 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
7:31 gcp-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
7:22 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:20 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:16 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
7:15 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:14 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:12 gcp-windows-latest-4core-16gb TestAccept/bundle/apps/job_permissions/DMS=true
7:08 gcp linux-2core-8gb TestAccept/bundle/deploy/spark-jar-task/DMS=
7:05 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
7:04 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
7:03 gcp linux-2core-8gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
7:02 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:57 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
6:57 gcp-windows-latest-4core-16gb TestAccept/bundle/templates/default-python/combinations/serverless/DLT=yes/DMS=/NBOOK=no/PY=yes/READPLAN=1
6:56 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
6:52 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
6:50 aws-windows-latest-4core-16gb TestAccept/bundle/deploy/spark-jar-task/DMS=true
6:47 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
6:46 azure-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN=
6:44 azure-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job.yml.tmpl/READPLAN=1
6:42 gcp-windows-latest-4core-16gb TestAccept/bundle/deploy/spark-jar-task/DMS=
6:39 gcp-windows-latest-4core-16gb TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=1
6:38 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:31 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:29 aws-windows-latest-4core-16gb TestAccept/bundle/deploy/spark-jar-task/DMS=
6:29 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
(112 table rows omitted to keep the report under 60000 bytes)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-auto PRs made by AI loops & factories, test-only-fix PRs that update failing of flaky tests without changing CLI code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants