Skip to content

Add MLPerf Llama 3.1 8B Recipes - #6475

Open
nv-mollys wants to merge 3 commits into
mainfrom
mollys/mlperf-llama3-8b-main
Open

nv-mollys wants to merge 3 commits into
mainfrom
mollys/mlperf-llama3-8b-main

Conversation

@nv-mollys

Copy link
Copy Markdown
Contributor

What does this PR do ?

Cherry-pick the MLPerf Llama 3.1 8B GB200/GB300 performance recipes from #5861 onto main and pin their layouts with unit tests.

Changelog

  • Add GB200 Llama 3.1 8B perf recipes: llama31_8b_pretrain_8gpu_gb200_nvfp4_config, llama31_8b_pretrain_72gpu_gb200_nvfp4_config, llama31_8b_pretrain_512gpu_gb200_fp8cs_config.
  • Add GB300 Llama 3.1 8B perf recipes: llama31_8b_pretrain_8gpu_gb300_nvfp4_config, llama31_8b_pretrain_72gpu_gb300_nvfp4_config, llama31_8b_pretrain_512gpu_gb300_fp8cs_config.
  • Add _llama31_8b_common() in perf_recipes/llama/common.py for the shared MLPerf optimizer, DDP, model, scheduler, dataset, checkpoint, logger, and tokenizer defaults.
  • Export the new recipe factories from perf_recipes/llama/__init__.py.
  • Stop setting cfg.model.attention_backend = None on the library llama31_8b_pretrain_2gpu_h100_bf16_config.
  • Add tests/unit_tests/recipes/test_llama31_8b_perf_recipes.py to pin parallelism, batch, LR, eval, CUDA graph, and precision for the six MLPerf recipes.
  • Port-time fixes in the common helper: import torch for bfloat16 dtypes, and assign cfg.rng.data_parallel_random_init instead of annotating it.

Additional Information

nv-mollys and others added 2 commits October 14, 2026 20:10
Signed-off-by: nv-mollys <149841089+nv-mollys@users.noreply.github.com>
Co-authored-by: mollys <mollys@mollys.nvidia.com>
(cherry picked from commit 24960ca)
Signed-off-by: mollys <mollys@mollys.nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Oct 15, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@nv-mollys
nv-mollys requested a review from yaoyu-33 October 15, 2026 03:17
@nv-mollys nv-mollys added area:perf Performance optimizations and benchmarking 26.10 labels Oct 15, 2026
@cuichenx cuichenx added the feature New capabilities, enhancements, or enablement work label Oct 15, 2026
@nv-mollys

Copy link
Copy Markdown
Contributor Author

/ok to test 805d564

@github-actions

Copy link
Copy Markdown
Contributor

Automatic Claude reviews have been retired. To request a pull-request review, post a comment containing:

/review

Add model=claude to use a Claude reviewer (the default is model=codex). mode=light|strict selects the review depth; for example, /review model=claude mode=strict. Comment /review help for all options.

This branch was successfully deployed

1 active deployment
test — 805d5640 Deployed Oct 15, 2026 by copy-pr-bot[bot] via cicd-wait-in-queue #22906
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

26.10 area:perf Performance optimizations and benchmarking feature New capabilities, enhancements, or enablement work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants