Skip to content

[https://nvbugs/6988813][test] Unwaive remote MPI submit_sync - #21205

Merged
chienchunhung merged 1 commit into
NVIDIA:mainfrom
chienchunhung:dev/unwaive-remote-mpi-submit-sync
Oct 29, 2026
Merged

chienchunhung merged 1 commit into
NVIDIA:mainfrom
chienchunhung:dev/unwaive-remote-mpi-submit-sync

Conversation

@chienchunhung

@chienchunhung chienchunhung commented Oct 28, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Remove the NVBUG 6988813 waiver for test_remote_mpi_session[submit_sync] so CI exercises it again on ARM and x86.

The relevant runtime change is #20434's lightweight MPI shutdown helper. Main also includes #20467's test-harness changes and 120-second subprocess bound. This PR only removes the waiver and validates the combined implementation.

Verification

Tested revision: e31ef8a72f57682b4f451d3884955236446ba852, based on main 3b4eebcf020e621fe47d54c1f6bea2dcfeb6dd36.

Targeted CI #66929 completed successfully, covering CPU-Generic-arm-1, CPU-Generic-arm-2, CPU-Generic-x86-1, and CPU-Generic-x86-2. The trigger disabled test-result reuse.

JUnit confirms execution of the exact affected test, unittest/llmapi/test_mpi_session.py::test_remote_mpi_session[submit_sync]:

Stage Result Duration
CPU-Generic-arm-1 Passed; not skipped 33.741 s
CPU-Generic-x86-1 Passed; not skipped 23.946 s
  • All six test_remote_mpi_session variants passed on each architecture (12/12 checks).
  • The pipeline's automatic retry was for the separate disaggregated ownership test test_cancel_after_publication_cannot_overtake_request_data; the affected MPI test was absent from the retry report.
  • Applicable pre-commit hooks, test-list validation, duplicate-waiver validation, DCO, and git diff --check passed. Self-review found no actionable issues.

This run verifies the unwaived test on the combined current implementation. It does not isolate #20434's effect from #20467 or establish that the historical intermittent failure is eliminated; subsequent CI runs will provide continued coverage.

  • Reviewed the repository PR checklist; existing tests cover this waiver-only change.

Dev Engineer Review

Removed the NVBUG 6988813 waiver for test_remote_mpi_session[submit_sync]. This changes test selection only; no runtime or test-harness code changed.

QA Engineer Review

Modified tests/integration/test_lists/waives.txt to remove the waiver for unittest/llmapi/test_mpi_session.py::test_remote_mpi_session[submit_sync]. The targeted CI run reported this test passed on ARM and x86, without being skipped; it validates the combined implementation, not the isolated effect of either related change. No matching entry was found in the supplied search of test-db/ or qa/ lists. Coverage verdict: sufficient for the waiver removal.

Per-File QA Perspective

  • tests/integration/test_lists/waives.txt: Removing this entry allows CI to run the affected MPI test instead of waiving it. The supplied CI results report a pass on ARM and x86.

Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast --disable-reuse-test --stage-list "CPU-Generic-x86-1,CPU-Generic-x86-2,CPU-Generic-arm-1,CPU-Generic-arm-2"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #81239 [ run ] triggered by Bot. Commit: e31ef8a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #81239 [ run ] completed with state SUCCESS. Commit: e31ef8a
/LLM/main/L0_MergeRequest_PR pipeline #66929 (Partly Tested) completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

CI Report

Link to invocation

@chienchunhung
chienchunhung marked this pull request as ready for review October 28, 2026 22:54
@coderabbitai

coderabbitai Bot commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review.

Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between 3b4eebc and e31ef8a.

Files selected for processing: 1
  • tests/integration/test_lists/waives.txt
Files with no reviewable changes: 1
  • tests/integration/test_lists/waives.txt

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 11 remain after this review.

Walkthrough

The change removes the skip-list entry for test_remote_mpi_session[submit_sync] and its NVBUG 6988813 reference.

Changes

Remote MPI test waiver

Layer / File(s) Summary
Remove the test waiver
tests/integration/test_lists/waives.txt
The skip-list entry for test_remote_mpi_session[submit_sync] and its NVBUG reference are removed.

Priority: Low

Estimated code review effort: 1 (Trivial) | ~2 minutes

Change: Other

Possibly related PRs

Suggested reviewers: trtllm-agent

Merge Risk: Minimal · up to e31ef

The synchronous remote MPI test is now eligible to run in CI. No actionable merge risk is identified.

Pre-merge checks: Passed 5
Check name Status Explanation
Title check Passed The title clearly identifies the NVBugs ticket, change type, and primary change: removing the waiver for the remote MPI submit_sync test.
Description check Passed The description explains the change, provides detailed verification results and test coverage, documents limitations, and confirms the repository checklist was reviewed. The alternative section names …
Docstring Coverage Passed No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documentat…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Description check

Explanation

The description explains the change, provides detailed verification results and test coverage, documents limitations, and confirms the repository checklist was reviewed. The alternative section names still contain the required information.

Full details: Docstring Coverage

Explanation

No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documentation-only edits and deletions within surviving functions are included; unchanged diff context and fully deleted functions are excluded. Analyzed 0 functions across 0 files.

Finishing Touches: 💡 1
🛠️ Fix failing CI checks: 💡
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@chienchunhung

Copy link
Copy Markdown
Collaborator Author

/bot skip --comment "Test unwaiving only; verified with the targeted CI pipeline."

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #81271 [ skip ] triggered by Bot. Commit: e31ef8a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #81271 [ skip ] completed with state SUCCESS. Commit: e31ef8a
Skipping testing for commit e31ef8a

Link to invocation

@github-actions

Copy link
Copy Markdown

Automatically added "ci: full pre-merge approved" because this PR has satisfied the required GitHub review approvals. Unresolved review conversations and other required checks remain independent merge requirements.

@chienchunhung
chienchunhung merged commit d008a9b into NVIDIA:main Oct 29, 2026
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants