Skip to content

[FS-2621] Enable DMS for Feature and MaterializationSet in DAB - #7369

Open
Daniel114510 wants to merge 5 commits into
mainfrom
fs2621-dms-feature-matset
Open

Daniel114510 wants to merge 5 commits into
mainfrom
fs2621-dms-feature-matset

Conversation

@Daniel114510

@Daniel114510 Daniel114510 commented Nov 5, 2026 •

Copy link
Copy Markdown
Member

Changes

  • Add the features and materialization_sets prefixes to the test server's deployment history allowlist, dmsResourceTypes.
  • Remove the exclusions that kept the feature and materialization set cases, and the invariant matrix's feature config, off the DMS=true leg. materialization_sets/bind and materialization_sets/settled_failure stay on the plain leg: bind refuses to run while deployment history is recorded, and with it recorded the destroy in settled_failure returns the delete error instead of forgiving it.

Why

The deployment metadata service is adding both resource-key prefixes, so a deploy that records deployment history will no longer fail for a bundle with a feature or materialization set.

Tests

  • Acceptance tests:
    • bundle/resources/features, bundle/resources/materialization_sets: both legs match one set of goldens
    • bundle/invariant: the feature config runs on the DMS=true leg
  • Cloud DMS=true runs: pending the service deploy

…tion sets

The deployment metadata service is gaining the features. and materialization_sets. resource-key
prefixes, so the test server's allowlist adds both, and the exclusions that kept these cases off
the DMS=true leg are removed. Every case produces the same goldens on both legs. bind and
settled_failure stay pinned to the plain leg for their own reasons.

Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions github-actions Bot added the DABs DABs related issues label Nov 5, 2026
@github-actions

github-actions Bot commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 28ef7d04d | Workflow run

Regression test report

Selected 13 changed tests (limit=20, 0 not selected)

26 tests: regression=0 unreleased=0 coverage=26 failing=0
test branch main (89a2fe8) latest (v1.26.0)
TestAccept/bundle/resources/features/basic/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/features/basic/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/features/lifecycle/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/features/lifecycle/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/features/remote-delete/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/features/remote-delete/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/basic/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/basic/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/batch/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/batch/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/destination/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/destination/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/immutable/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/immutable/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/invalid_members/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/invalid_members/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/membership/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/membership/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/mixed_triggers/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/mixed_triggers/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/removal_scope/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/removal_scope/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/sawtooth/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/sawtooth/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/streaming/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/materialization_sets/streaming/DMS=true ✅ ✅ ✅

@Daniel114510 Daniel114510 changed the title [FS-2621] Run the deployment history leg for features and materializa… [FS-2621] Enable DMS for Feature and MaterializationSet in DAB Nov 5, 2026
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Nov 5, 2026 •

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 28ef7d0

Run: 43071266911

Env 🔄​flaky ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 283 24 12:50
🔄​ aws-windows-latest-4core-16gb 3 282 22 14:08
🔄​ azure linux-2core-8gb 4 278 24 22:14
✅​ azure-windows-latest-4core-16gb 284 22 14:12
✅​ gcp linux-2core-8gb 283 24 16:21
🔄​ gcp-windows-latest-4core-16gb 7 278 22 28:59
9 interesting tests: 9 flaky
Test Name aws-windows-latest-4core-16gb azure linux-2core-8gb gcp-windows-latest-4core-16gb
🔄​ TestAccept 🔄​f ✅​p ✅​p
🔄​ TestAccept/bundle/resources/features/lifecycle 🔄​f 🔄​f 🔄​f
🔄​ TestAccept/bundle/resources/features/lifecycle/DMS= 🔄​f ✅​p 🔄​f
🔄​ TestAccept/bundle/resources/features/lifecycle/DMS=true ✅​p 🔄​f ✅​p
🔄​ TestAccept/bundle/resources/materialization_sets/batch ✅​p 🔄​f 🔄​f
🔄​ TestAccept/bundle/resources/materialization_sets/batch/DMS= ✅​p 🔄​f 🔄​f
🔄​ TestAccept/bundle/resources/materialization_sets/immutable ✅​p ✅​p 🔄​f
🔄​ TestAccept/bundle/resources/materialization_sets/immutable/DMS=true ✅​p ✅​p 🔄​f
🔄​ TestSyncFullFileSync ✅​p ✅​p 🔄​f
Top 42 slowest tests (at least 2 minutes):
duration env testname
6:55 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
6:49 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
6:19 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
6:00 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
5:57 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
5:47 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
5:28 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
5:24 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
5:18 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
5:16 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
5:07 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
4:57 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
4:40 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
4:37 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
4:34 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
4:32 aws linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
4:06 gcp linux-2core-8gb TestAccept
4:03 aws linux-2core-8gb TestAccept
4:02 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
3:54 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
3:53 gcp-windows-latest-4core-16gb TestImportDir
3:52 aws linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
3:50 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
3:45 aws linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
3:37 gcp-windows-latest-4core-16gb TestFilerReadWrite/workspace_files_extensions
3:36 azure-windows-latest-4core-16gb TestAccept
3:13 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
3:10 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
3:07 aws linux-2core-8gb TestFilerWorkspaceFilesExtensionsReadDir
3:01 gcp-windows-latest-4core-16gb TestSyncFullFileSync
3:01 gcp linux-2core-8gb TestFilerRecursiveDelete/workspace_files
2:45 aws linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=true
2:29 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/removal_scope/DMS=
2:15 gcp linux-2core-8gb TestAccept/bundle/resources/features/lifecycle/DMS=true
2:11 azure linux-2core-8gb TestFilerRecursiveDelete/workspace_files_extensions
2:06 gcp linux-2core-8gb TestImportDirWithOverwriteFlag
2:06 azure-windows-latest-4core-16gb TestAccept/bundle/resources/features/lifecycle/DMS=
2:03 aws-windows-latest-4core-16gb TestAccept/bundle/resources/features/lifecycle/DMS=true
2:02 azure-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/removal_scope/DMS=true
2:02 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/removal_scope/DMS=true
2:02 gcp linux-2core-8gb TestFilerRecursiveDelete/workspace_files_extensions
2:01 gcp linux-2core-8gb TestAccept/bundle/resources/features/lifecycle/DMS=

Daniel114510 and others added 3 commits November 9, 2026 07:00
Co-authored-by: Isaac <no-reply@databricks.com>
…tset

# Conflicts:
#	acceptance/bundle/invariant/test.toml
Co-authored-by: Isaac <no-reply@databricks.com>
@Daniel114510
Daniel114510 marked this pull request as ready for review November 9, 2026 17:37
@Daniel114510
Daniel114510 requested review from a team as code owners November 9, 2026 17:37

@janniklasrose janniklasrose left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approving but this can only merge once the backend changes have propagated and the test suite is green

@denik denik added the test-only-fix PRs that update failing of flaky tests without changing CLI code. label Nov 11, 2026
…tset

Co-authored-by: Isaac <no-reply@databricks.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues test-only-fix PRs that update failing of flaky tests without changing CLI code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants