Repository navigation
feat(recipe): backport NT3 Ultra performance updates to r0.7.0 (#6228) - #6437
Merged
Merged
Conversation
Add GTP, partial CUDA graphs, cuDNN layer normalization, and NCCL EP updates for Nemotron 3 Ultra MXFP8 performance recipes. (cherry picked from commit 2eca468) Signed-off-by: Ravi Ghadia <rghadia@nvidia.com> Signed-off-by: Malay Nagda <malayn@nvidia.com>
malay-nagda
added
feature
Contributor
|
Automatic Claude reviews have been retired. To request a pull-request review, post a comment containing: Add |
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Backport of #6228 to
r0.7.0, cherry-picked from2eca46823b0a2cb24f895bd567af14bef8350d37without conflicts. The backport patch ID matches the merged source commit.Adds GTP sharding, partial CUDA graphs, cuDNN layer normalization, and NCCL EP updates to the Nemotron 3 Ultra MXFP8 performance recipes for GB200, GB300, and VRNVL72. Includes the original training integration, CUDA graph validation changes, and updated unit tests.
The required VRNVL72 rename is already on
r0.7.0through #6436.Validation:
uv run --no-project --with pre-commit pre-commit run --all-files.git diff --cached --checkpassed; patch ID matches the source commit.