Repository navigation
Add PlatformValidation management scenario tests with recording/playback - #50724
Open
shivangirana20 wants to merge 7 commits into
Open
shivangirana20 wants to merge 7 commits into
shivangirana20 wants to merge 7 commits into
Conversation
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 4b765d16-4aa7-490a-a31d-a9166f5da2e7
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 4b765d16-4aa7-490a-a31d-a9166f5da2e7
Member
Author
|
/azp run prepare-pipelines |
github-actions
Bot
added
the
Mgmt
|
Azure Pipelines: Successfully started running 1 pipeline(s). |
|
Azure Pipelines: Successfully started running 1 pipeline(s). 35 pipeline(s) were filtered out due to trigger conditions. There may be pipelines that require an authorized user to comment /azp run to run. |
shivangirana20
changed the title
shivangirana20
marked this pull request as ready for review
October 28, 2026 21:12
shivangirana20
requested review from
a team,
Arthur Ma (ArthurMa1978),
Xiaofei Cao (XiaofeiCao),
Haoling Dong (haolingdong-msft) and
Weidong Xu (weidongxu-microsoft)
as code owners
October 28, 2026 21:12
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
The live tests can fail with IllegalAccessError due to a missing test-only module read edge, and shared teardown can delete investigation resources after test failures, bypassing cleanup safeguards.
2 open issues
What changed in this PR
Adds live management-plane coverage for PlatformValidation, with pipeline setup and local execution guidance. Production and generated SDK code remain unchanged.
Changes:
- Adds eight live scenarios covering resource lifecycles, boot execution, catalog discovery, and operation status.
- Adds ten helper regressions for cleanup, polling, endpoint configuration, image validation, and serialization.
- Configures a serial Windows live-test pipeline with optional boot execution and documents prerequisites and safeguards.
| File | Description |
|---|---|
sdk/platformvalidation/tests.mgmt.yml |
Configures serial Canary testing and optional image-backed execution. |
sdk/platformvalidation/test-resources.bicep |
Grants parent-group Contributor access and exports test configuration. |
sdk/platformvalidation/azure-resourcemanager-platformvalidation/src/test/java/com/azure/resourcemanager/platformvalidation/PlatformValidationLiveTests.java |
Adds live scenarios and guarded cleanup helpers. |
sdk/platformvalidation/azure-resourcemanager-platformvalidation/src/test/java/com/azure/resourcemanager/platformvalidation/PlatformValidationLiveTestHelpersTests.java |
Adds offline regression tests for live-test helpers. |
sdk/platformvalidation/azure-resourcemanager-platformvalidation/README.md |
Documents live-test setup, safeguards, and pipeline usage. |
sdk/platformvalidation/azure-resourcemanager-platformvalidation/pom.xml |
Adds test-scoped resource-management and test-framework dependencies. |
sdk/platformvalidation/azure-resourcemanager-platformvalidation/CHANGELOG.md |
Records endpoint configuration and cleanup retry changes. |
Review effort: Balanced
| @@ -48,6 +48,18 @@ | |||
| <revapi.skip>true</revapi.skip> | |||
| </properties> | |||
| parameters: | ||
| ServiceDirectory: platformvalidation | ||
| MaxParallel: 1 | ||
| TestOptions: '$(TestOptions) -Djunit.jupiter.execution.parallel.enabled=false' |
Member
|
/azp run java - platformvalidation - mgmt - tests |
|
Azure Pipelines: Successfully started running 1 pipeline(s). |
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 6685658c-c986-42c5-aee8-fca8f020c7ee
Member
Author
|
/azp run java - platformvalidation - mgmt - tests |
|
Azure Pipelines: Successfully started running 1 pipeline(s). |
Preserve full CV, plan, run, and test-result validation using approved-subscription recordings. Publish sanitized assets and verify all scenarios without Azure credentials. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 6685658c-c986-42c5-aee8-fca8f020c7ee
shivangirana20
changed the title
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add PlatformValidation management scenario tests and migrate them from live-only execution to
ResourceManagerTestProxyTestBaserecording/playback, following the Java SDK team's recommendation and the management test framework guide.Recordings were captured in the service-enabled subscription using the same approved VHD fixture as the other language tests. Normal PR tests now use playback without Azure credentials, image secrets, or the shared SDK subscription being enabled for this service. No production/generated SDK code changes.
Coverage and safety
Published recordings
All eight recordings are published to
Azure/azure-sdk-assets;assets.jsonpins:java/platformvalidation/azure-resourcemanager-platformvalidation_81dc07912eThe recording audit found no original subscription/tenant IDs, approved image URL/storage host/signature, emails, or remaining SAS queries. Refresh recordings for each new API-version SDK PR.
Validation
git diff --checkpassed.Optional live pipeline
The existing live pipeline and provisioning files remain available, but are not required for playback. Its shared subscription still needs RP registration/regional enablement before live tests can pass; this migration does not claim that environment issue is fixed. Boot execution in RECORD/LIVE remains an explicit opt-in with a secret image fixture.