Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
e7540cb
[🤖]: Update docs-versions after code-freeze for r0.6.0
github-actions[bot] Jul 28, 2026
2b56a25
Bump docs version to r0.6.0
github-actions[bot] Jul 28, 2026
6c0ad53
cp: `Add SequentialMLP mappings for MTP heads in nemotron_h_bridge.py…
svcnvidia-nemo-ci Jul 29, 2026
0720b49
cp: `[test] fix: repair Nemotron-H CI regressions (5143)` into `r0.6.…
svcnvidia-nemo-ci Jul 30, 2026
08acf56
cp: Nemotron 3.5 Nano verification card and final-checkpoint refresh …
svcnvidia-nemo-ci Jul 30, 2026
ff37951
cp: `fix(docker): update dependencies in Dockerfile and fw_pyproject.…
svcnvidia-nemo-ci Jul 31, 2026
9544c93
cp: `fix(model): map GLM-5 routed expert count (5220)` into `r0.6.0` …
svcnvidia-nemo-ci Aug 3, 2026
c2b85a3
cp: `feat(sft): DSv4 Flash offline-packed SFT with THD + CP (5126)` i…
svcnvidia-nemo-ci Aug 3, 2026
359609f
cp: `[Doc] Document latest Mcore toggle `moe_hybridep_pad_uneven_disp…
svcnvidia-nemo-ci Aug 3, 2026
aad7177
cp: `fix(perf): port r0.5.0 VR200 performance configs (5196)` into `r…
svcnvidia-nemo-ci Aug 3, 2026
9472ca2
cp: `feat(misc): add memory snapshot analysis skill (5150)` into `r0.…
svcnvidia-nemo-ci Aug 3, 2026
a1e812e
cp: `fix(model): add Gemma 3 VL verification coverage (5084)` into `r…
svcnvidia-nemo-ci Aug 3, 2026
77e25d2
cp: `fix(training): preserve alltoall flex fallback (5207)` into `r0.…
svcnvidia-nemo-ci Aug 3, 2026
4c10b8e
cp: `fix(model): align MiniMax evidence and inference task routing (5…
svcnvidia-nemo-ci Aug 3, 2026
44f5668
cp: `fix(peft): sync grouped expert LoRA over expert DP (5231)` into …
svcnvidia-nemo-ci Aug 3, 2026
af2d5b4
cp: `chore(deps): update mlflow version to 3.15.0 (5267)` into `r0.6…
svcnvidia-nemo-ci Aug 4, 2026
a2fec25
chore: bump mcore dev commit for DSv4 support (#5284)
weijiac0619 Aug 4, 2026
d4bf3f1
cp: `fix(recipes): derive pretraining vocab from tokenizer (4996)` in…
cuichenx Aug 4, 2026
a91e2ab
cp: `fix(data): preserve VLM pixel defaults (5218)` into `r0.6.0` (#5…
svcnvidia-nemo-ci Aug 4, 2026
3626e28
cp: `fix(data): reject truncation without supervision (5217)` into `r…
svcnvidia-nemo-ci Aug 4, 2026
fdffbe0
cp: `fix(data): normalize GLM VLM assistant content (5216)` into `r0.…
svcnvidia-nemo-ci Aug 4, 2026
c5a6aae
cp: `fix(data): pad Qwen VLM token type IDs (5215)` into `r0.6.0` (#5…
svcnvidia-nemo-ci Aug 4, 2026
b757704
cp: `perf(recipe): tune Nemotron 3.5 Nano H100 benchmark (5266)` into…
svcnvidia-nemo-ci Aug 4, 2026
df9cfb1
cp: `fix(training): restore weak scaling for benchmark recipes (5222)…
svcnvidia-nemo-ci Aug 4, 2026
6770772
chore(deps): update transformer-engine dependency to a new commit hash
balasaajay Aug 4, 2026
1f2d8e6
cp: `feat (recipe): add Nemotron 3 Ultra MXFP8 GB200 pretraining perf…
svcnvidia-nemo-ci Aug 5, 2026
9d4eef4
cp: `fix(training): count expert parameter norms with TP and EP (4998…
svcnvidia-nemo-ci Aug 5, 2026
9182eed
cp: `fix(model): restore DeepSeek V3 sequence auxiliary loss (5165)` …
svcnvidia-nemo-ci Aug 5, 2026
e1f8367
cp: Nemotron 3.5 Lightning checkpoint and naming updates (#5293, #530…
svcnvidia-nemo-ci Aug 5, 2026
3bc4e4d
fix(training): backport HybridEP uneven-dispatch compatibility to r0.…
cuichenx Aug 5, 2026
872ac76
perf(recipe): add DeepSeek V4 Flash GB300 FP8MX recipes (#5258)
malay-nagda Aug 5, 2026
59a658f
cp: `build: bump nvidia-modelopt to 0.46.0rc1 (5331)` into `r0.6.0` (…
svcnvidia-nemo-ci Aug 5, 2026
3695089
chore(docker): update Dockerfile and install script to remove unneces…
balasaajay Aug 5, 2026
d51ba9f
build: AUT-1353 bump transformer-engine to 2.17.1 (#5349)
svcnemo-autobot Aug 5, 2026
6084efb
build: AUT-1346 pin wandb to 0.27.2 (#5348)
svcnemo-autobot Aug 5, 2026
9177087
fix(ci): AUT-1359 skip humming module in import check (#5358)
svcnemo-autobot Aug 5, 2026
63e2b00
fix(model): AUT-1326 backport Gemma 3 VL fused attention to r0.6.0 (#…
svcnemo-autobot Aug 6, 2026
c395bf3
fix(recipe): backport #5386 batch-size alignment to r0.6.0 (#5393)
cuichenx Aug 6, 2026
c6ed307
cp: `fix(perf): mount common performance scripts (5381)` into `r0.6.0…
svcnvidia-nemo-ci Aug 7, 2026
095e8cb
chore(deps): update mlflow to 3.15.1 (#5419)
balasaajay Aug 7, 2026
2f7c888
cp: `feat(model): add GLM-5.2 verification card (5034)` into `r0.6.0`…
svcnvidia-nemo-ci Aug 7, 2026
9b5e304
cp: `fix(ckpt): validate conversion world size against TP*PP, not TP*…
svcnvidia-nemo-ci Aug 7, 2026
659077e
cp: `[docs] fix: point Gemma 4 VL inference to verification card (531…
svcnvidia-nemo-ci Aug 7, 2026
3490b59
fix(model): enable RADIO recompute for Nemotron Omni SFT (#5320)
cuichenx Aug 7, 2026
9391fdf
cp: `[model] fix: honor Gemma 4 image attention mode (5333)` into `r0…
svcnvidia-nemo-ci Aug 7, 2026
9567452
cp: `[ckpt] fix: support vocab padding with Megatron-FSDP TP (5353)` …
svcnvidia-nemo-ci Aug 7, 2026
29c30dd
cp: `fix(ckpt): avoid roundtrip export barrier timeout (5377)` into `…
svcnvidia-nemo-ci Aug 7, 2026
9371508
cp: `fix(peft): preserve grouped expert SwiGLU LoRA order (5376)` int…
svcnvidia-nemo-ci Aug 7, 2026
8003b11
cp: `fix(training): include MTP stages in embedding groups (5380)` in…
yaoyu-33 Aug 8, 2026
41d8135
cp: `fix: repair release QA regressions (5351)` into `r0.6.0` (#5423)
yaoyu-33 Aug 8, 2026
324a8f7
cp: `[models, conversion] fix: verify Step-3.5 model workflows (5334)…
yaoyu-33 Aug 8, 2026
bad2907
cp: `fix(training): surface distributed failures without cleanup hang…
svcnvidia-nemo-ci Aug 8, 2026
d9121e7
cp: `fix(modelopt): handle sparse export task lists (5374)` into `r0.…
svcnvidia-nemo-ci Aug 8, 2026
845bcf7
cp: `fix(ckpt): restrict dataloader state deserialization (5418)` int…
svcnvidia-nemo-ci Aug 8, 2026
02bd384
cp: `fix(recipes): use max-pool FSDP for Qwen3.5-VL (5402)` into `r0.…
svcnvidia-nemo-ci Aug 8, 2026
cdafbeb
cp: `fix(recipe): verify GLM-5.2 RP2 pretraining and packed SFT (5344…
yaoyu-33 Aug 8, 2026
bb94c3f
cp: `[examples] refactor: direct GLM inference to model card (5346)` …
yaoyu-33 Aug 8, 2026
f01b1f3
cp: `docs(models): link MiMo and StepFun examples (5432)` into `r0.6.…
svcnvidia-nemo-ci Aug 8, 2026
3264eda
cp: `docs(recipe): retire stale Gemma 4 VL SFT launchers (5433)` into…
svcnvidia-nemo-ci Aug 8, 2026
75e6be5
cp: `fix(peft): synchronize shared expert LoRA across EP (5396)` into…
svcnvidia-nemo-ci Aug 8, 2026
8fe66b5
cp: `fix(model): preserve Step3.7 text config fields (5417)` into `r0…
svcnvidia-nemo-ci Aug 8, 2026
07d182e
cp: `[ckpt] fix: Deinterleave low-memory GLU checkpoints (5366)` into…
svcnvidia-nemo-ci Aug 9, 2026
9905b29
Update wandb dependency version to 0.27.2 (#5461)
balasaajay Aug 10, 2026
13ed820
fix(model): backport Gemma4 PLE sequence parallel sharding to r0.6.0 …
cuichenx Aug 10, 2026
e78f969
cp: `fix(data): collate ragged packed sequence metadata (5400)` into …
yaoyu-33 Aug 10, 2026
2bc595f
build: AUT-1430 upgrade GitPython to 3.1.58 (#5480)
svcnemo-autobot Aug 10, 2026
802b7f6
cp: `fix(models): use HybridEP for MiniMax-M3 expert parallelism (544…
svcnvidia-nemo-ci Aug 10, 2026
e6b2cbb
cp: `fix(diffusion): calculate WAN FLOPs from runtime geometry (5249)…
svcnvidia-nemo-ci Aug 11, 2026
0ed053d
cp: `feat(data): infer assistant loss mask for gpt-oss Harmony chat t…
svcnvidia-nemo-ci Aug 11, 2026
0494f09
cp: `fix(scripts): preserve FHT and fetch missing MCore commits (5478…
svcnvidia-nemo-ci Aug 11, 2026
dd61c0c
cp: `fix(models): use HybridEP for Kimi-K2.5 inference (5421)` into `…
cuichenx Aug 11, 2026
e790259
cp: `fix(model): handle disabled GLM-5 MTP export (5445)` into `r0.6.…
svcnvidia-nemo-ci Aug 11, 2026
dd05e1a
cp: `docs(ckpt): document roundtrip scaling limits (5491)` into `r0.6…
svcnvidia-nemo-ci Aug 11, 2026
3ee5173
cp: `docs(model-card): add Nemotron 3 Super verification card (5062)`…
svcnvidia-nemo-ci Aug 11, 2026
5796c06
cp: `docs: update performance summary for 26.08 (5496)` into `r0.6.0`…
svcnvidia-nemo-ci Aug 11, 2026
c2e93d8
cp: `fix(deepseek-v4): use full-prefix inference (5509)` into `r0.6.0…
svcnvidia-nemo-ci Aug 11, 2026
b888318
cp: `fix(recipe): prevent Qwen3.5-VL FSDP SFT OOM (5508)` into `r0.6.…
svcnvidia-nemo-ci Aug 11, 2026
5b70a4c
fix(recipe): recompute Gemma 4 VL SFT layers (#5506)
yaoyu-33 Aug 11, 2026
7b5057e
cp: `docs(dsv4): preserve container packages during MCore sync (5514)…
svcnvidia-nemo-ci Aug 11, 2026
c932511
Update nemo-evaluator path in fw_pyproject.toml (#5571)
balasaajay Aug 13, 2026
8e43ce6
docs: Update 0.6.0 version entries for docs (#5567)
balasaajay Aug 13, 2026
cea3a73
cp: `fix(deepseek): default DeepSeek V4 to HybridEP (5543)` into `r0.…
svcnvidia-nemo-ci Aug 14, 2026
0f113ab
docs: fix preferred version and add 0.5.1 to the version picker (#5623)
ko3n1g Aug 17, 2026
51885cf
beep boop 🤖: Bumping Megatron-Bridge to v0.6.1 [skip ci]
github-actions[bot] Aug 19, 2026
53bea08
models: add Apertus / Apertus 1.5 bridges
theely Sep 1, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .dev.commit
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0e6ac576fba8995fca541ceb6af5f35eb0e4f16e
43e45e13074f36da68b34c7a189cd997a01d1b41
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -229,7 +229,7 @@ Megatron Bridge provides out-of-the-box bridges and training recipes for a wide
| **Ernie** | [Ernie 4.5 MoE](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/src/megatron/bridge/models/ernie), [Ernie 4.5 VL MoE](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/src/megatron/bridge/models/ernie_vl) |
| [**Falcon**](docs/models/falcon/index.md) | Falcon H1 |
| [**Gemma**](docs/models/gemma/index.md) | Gemma / Gemma 2 (deprecated), Gemma 3, Gemma 3-VL, Gemma 4 (26B-A4B MoE / 31B dense), Gemma 4-VL (26B-A4B MoE) |
| [**GLM**](docs/models/glm/index.md) | GLM-4.5 / 4.7 / 4.7-Flash, GLM-4.5V, GLM-5 / 5.1 |
| [**GLM**](docs/models/glm/index.md) | GLM-4.5 / GLM-4.7 / GLM-4.7-Flash, GLM-4.5V, GLM-5 / GLM-5.1 / GLM-5.2 |
| [**GPT-OSS**](docs/models/gpt_oss/index.md) | GPT-oss |
| [**HY V3**](https://huggingface.co/tencent/Hy3-preview-Base) | Hy3 preview-Base (HF → Megatron checkpoint conversion) |
| [**Kimi**](docs/models/kimi/index.md) | Kimi K2, Kimi-K2.5-VL |
Expand Down
3 changes: 1 addition & 2 deletions docker/Dockerfile.ci
Original file line number Diff line number Diff line change
Expand Up @@ -65,8 +65,7 @@ ENV PATH="/opt/venv/bin:/opt/venv/bin:/root/.local/bin:$PATH" \
RUN --mount=type=bind,source=docker/patches/deepep.patch,target=/opt/deepep.patch \
curl -LsSf https://astral.sh/uv/${UV_VERSION}/install.sh | sh && \
uv venv ${UV_PROJECT_ENVIRONMENT} --system-site-packages && \
# Address CVE-2025-68973
apt-get update && apt install -y --only-upgrade gnupg && \
apt-get update && apt install -y --only-upgrade gnupg openssl libssl3t64 && \
apt-get clean && \
rm -rf /var/lib/apt/lists/* && \
if [ "$INSTALL_DEEPEP" = "True" ]; then \
Expand Down
33 changes: 19 additions & 14 deletions docker/Dockerfile.fw_final
Original file line number Diff line number Diff line change
Expand Up @@ -71,35 +71,38 @@ RUN \
##
##############################################################################

RUN pip install "starlette==0.49.1" \
RUN pip install "fastapi==0.139.1" \
"starlette==1.3.1" \
"prometheus-fastapi-instrumentator>=8.0.0" \
"urllib3>=2.7.0" \
"aiohttp>=3.13.3" \
"jaraco-context>=6.1.0" \
"wheel>=0.46.2" \
"python-multipart>=0.0.22" \
"setuptools>=80.10.2" \
"pillow>=12.1.1" \
"pillow>=12.3.0" \
"protobuf==6.33.5" \
"xgrammar>=0.1.32" \
"tornado==6.5.5" \
"tornado==6.5.6" \
"black==26.3.1" \
"onnx==1.21.0" \
"notebook>=7.5.6" \
"jupyterlab>=4.5.7" \
"jupyter-server>=2.18.0" \
"mistune>=3.2.1" \
"GitPython>=3.1.50" && \
"jupyterlab>=4.5.10" \
"jupyter-server>=2.20.0" \
"mistune>=3.3.0" \
"GitPython>=3.1.58" && \
# Address CVE from transitive dependency
pip uninstall -y opencv-python-headless nvidia-dali-cuda130

# Remove the package pulled in by Humming kernels.
# Humming-backed vLLM quantization is unavailable without pyelftools.
pip uninstall -y opencv-python-headless nvidia-dali-cuda130 pyelftools
# Remove PyTorch's bundled third-party onnx source tree (build artifact, not used at runtime).
# The actual onnx Python package is managed above via pip/uv; this stale copy triggers CVE scanners.
RUN rm -rf /opt/pytorch/pytorch/third_party/onnx

# Patch wandb-core: bump google.golang.org/grpc from 1.79.2 to 1.79.3 (CVE fix)
# Patch wandb-core with fixed gRPC-Go and Go standard-library versions.
ARG TARGETARCH
RUN GRPC_VERSION=1.79.3 && \
GO_VERSION=1.26.1 && \
RUN GRPC_VERSION=1.82.1 && \
GO_VERSION=1.26.5 && \
WANDB_VERSION=$(python3 -c "import wandb; print(wandb.__version__)") && \
WANDB_CORE_BIN=/opt/venv/lib/python3.12/site-packages/wandb/bin/wandb-core && \
curl -fsSL "https://dl.google.com/go/go${GO_VERSION}.linux-${TARGETARCH}.tar.gz" | tar -C /tmp -xz && \
Expand All @@ -114,12 +117,13 @@ RUN GRPC_VERSION=1.79.3 && \
-o "${WANDB_CORE_BIN}" ./cmd/wandb-core/ && \
rm -rf /tmp/wandb-src /tmp/go /tmp/gopath

# Patch wandb-core (dist-packages copy): bump github.com/go-git/go-git/v5 to 5.19.0 (CVE fix).
# Patch wandb-core (dist-packages copy) with fixed go-git, gRPC-Go, and Go versions.
# This stock upstream binary ships with go-git v5.17.2 and is a separate wandb install from the
# /opt/venv copy rebuilt above, so it must be rebuilt against its own wandb version (resolved via
# the system interpreter that owns dist-packages) to avoid a python/wandb-core version mismatch.
RUN GO_GIT_VERSION=5.19.0 && \
GO_VERSION=1.26.1 && \
GRPC_VERSION=1.82.1 && \
GO_VERSION=1.26.5 && \
WANDB_VERSION=$(/usr/bin/python3 -c "import wandb; print(wandb.__version__)") && \
WANDB_CORE_BIN=/usr/local/lib/python3.12/dist-packages/wandb/bin/wandb-core && \
curl -fsSL "https://dl.google.com/go/go${GO_VERSION}.linux-${TARGETARCH}.tar.gz" | tar -C /tmp -xz && \
Expand All @@ -128,6 +132,7 @@ RUN GO_GIT_VERSION=5.19.0 && \
git clone --depth 1 --branch "v${WANDB_VERSION}" https://github.com/wandb/wandb.git /tmp/wandb-src && \
cd /tmp/wandb-src/core && \
go get github.com/go-git/go-git/v5@v${GO_GIT_VERSION} && \
go get google.golang.org/grpc@v${GRPC_VERSION} && \
go mod tidy && \
go mod vendor && \
CGO_ENABLED=0 GOOS=linux GOARCH=${TARGETARCH} go build -trimpath -ldflags="-s -w" \
Expand Down
15 changes: 9 additions & 6 deletions docker/common/fw_pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ test = ["coverage>=7.8.1"]

[tool.uv.sources]
"nemo-export-deploy" = { path = "/opt/Export-Deploy", editable = true }
"nemo-evaluator" = { path = "/opt/Evaluator", editable = true }
"nemo-evaluator" = { path = "/opt/Evaluator/packages/nemo-evaluator", editable = true }
"nemo-run" = { path = "/opt/Run", editable = true }
"lightning" = { path = "stubs/lightning" }

Expand All @@ -67,9 +67,9 @@ override-dependencies = [
"packaging>=25.0",
"nvidia-pytriton>=0.7.0",
"urllib3>=2.0.7",
"sh==2.2.2",
"sh==2.2.4",
"jupyter-core==5.8.1",
"pillow==12.2.0",
"pillow==12.3.0",
"protobuf==6.33.5",
"cuda-python>=13.0.0",
"multi-storage-client!=0.36.0",
Expand All @@ -79,7 +79,7 @@ override-dependencies = [
"apache-tvm-ffi==0.1.11",
"levenshtein; sys_platform == 'never'",
"pytest==8.4.2",
"wandb>=0.25.0",
"wandb==0.27.2",
"nvidia-lm-eval==25.11.1",
"lilcom==1.8.1",
"onnx==1.21.0", # TRT-LLM hard dependency
Expand Down Expand Up @@ -115,12 +115,15 @@ override-dependencies = [
"setuptools>=82.0.0", # Required by vllm
"open-clip-torch>=3.2.0", # Required by megatron-bridge, override nemo-toolkit's 2.24.0 constraint
"lilcom!=1.8.2",
"cryptography>=43.0.0,<47", # Required by megatron-bridge, override nemo-run's constraint
"cryptography>=48.0.1,<49", # Required by megatron-bridge, override nemo-run's constraint
"opencv-python; sys_platform == 'never'", # Use the dependency from the base pytorch container
"langchain~=1.0.0",
"langchain-core~=1.3.3", # GHSA-pjwx-r37v-7724
"decord; sys_platform == 'never'", # Optional dependency. Resolves CVE
"av; sys_platform == 'never'", # Optional dependency. Resolves CVE
"opencv-python-headless; sys_platform == 'never'", # Optional dependency. Resolves CVE
"fastapi<0.139.2" # 0.139.2 fails with ray 2.55.1 at least
"ray>=2.56.0",
"starlette==1.3.1",
"prometheus-fastapi-instrumentator>=8.0.0", # 7.x requires starlette<1.0.0
"fastapi<0.139.2" # 0.139.2 fails with ray serve
]
1 change: 1 addition & 0 deletions docker/common/import_check_skip.txt
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ torch_tensorrt
quack # imports nvidia-cutlass-dsl MLIR libs, which dlopen libcuda at import
peft # transitively imports optional CUDA-backed modules that dlopen libcuda
transformer_engine # dlopens libcuda at import
humming # Humming vLLM quantization kernels dlopen libcuda at import

# Requires the libfuse system library (multi-storage-client FUSE backend; optional):
mfusepy
Expand Down
8 changes: 6 additions & 2 deletions docker/common/install_aws_ofi_nccl.sh
Original file line number Diff line number Diff line change
Expand Up @@ -42,8 +42,6 @@ SRC_DIR="$(mktemp -d)"
apt-get update
apt-get install -y --no-install-recommends \
git ca-certificates build-essential autoconf automake libtool libhwloc-dev
apt-get clean
rm -rf /var/lib/apt/lists/*

git clone --depth 1 --branch "${AWS_OFI_NCCL_VER}" \
https://github.com/aws/aws-ofi-nccl.git "${SRC_DIR}"
Expand All @@ -63,6 +61,12 @@ make -j"$(nproc)"
make install
popd

# The installed plugin links to libhwloc15 at runtime but does not need the
# development headers or libltdl development files after compilation.
apt-get purge -y libhwloc-dev libltdl-dev
apt-get clean
rm -rf /var/lib/apt/lists/*

# Revive the ldconfig entry the base image left behind so a bare `libnccl-net.so`
# lookup can also resolve here; EKSEnvPlugin still pins the absolute path.
echo "${PREFIX}/lib" > /etc/ld.so.conf.d/aws-ofi-nccl.conf
Expand Down
2 changes: 1 addition & 1 deletion docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@
project = "Megatron Bridge"
copyright = "2026, NVIDIA Corporation"
author = "NVIDIA Corporation"
release = "nightly"
release = "0.6.0"

# -- General configuration ---------------------------------------------------
# https://www.sphinx-doc.org/en/master/usage/configuration.html#general-configuration
Expand Down
2 changes: 2 additions & 0 deletions docs/fern/versions/nightly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -298,6 +298,8 @@ navigation:
path: ../../../skills/nemo-mbridge-multi-node-slurm/SKILL.md
- page: Templates
path: ../../../skills/nemo-mbridge-multi-node-slurm/references/templates.md
- page: Memory Snapshot Analysis
path: ../../../skills/nemo-mbridge-memory-snapshot-analysis/SKILL.md
- page: Resiliency
path: ../../../skills/nemo-mbridge-resiliency/SKILL.md
section: Agent Skills Reference
Expand Down
8 changes: 7 additions & 1 deletion docs/fern/versions/nightly/pages/training/profiling.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,13 @@ cfg.profiling = ProfilingConfig(

### Analyze Memory Usage

After the run completes, memory snapshots for each specified rank are saved to the designated path. Load these traces using the PyTorch Memory Viz tool to plot memory usage over time and detect bottlenecks or leaks in your training pipeline.
After the run completes, memory snapshots for each specified rank are saved to the designated path, with the rank inserted before the extension (for example, `memory_trace_0.pickle`). Load these traces using the PyTorch Memory Viz tool to plot memory usage over time and detect bottlenecks or leaks in your training pipeline.

For comparing two runs, attributing peak memory to specific allocation sites, or drilling into a captured out-of-memory snapshot, see the Memory Snapshot Analysis skill, which bundles scripts for replaying and diffing these files.

<Note>
`record_memory_history` and `use_pytorch_profiler` are independent settings. `ProfilerStep#N` annotations inside the snapshot come from the PyTorch profiler, so a snapshot captured with `record_memory_history=True` alone contains no step boundaries. Enable both if you want per-step memory analysis.
</Note>

## Optimize Profiling Accuracy

Expand Down
3 changes: 3 additions & 0 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,13 @@ bridge-tech-details.md
models/README.md
models/bailing/index.md
models/deepseek/index.md
models/ernie/ernie45.md
models/exaone/exaone.md
models/falcon/index.md
models/gemma/index.md
models/glm/index.md
models/gpt_oss/index.md
models/hy_v3/hy-v3.md
models/kimi/index.md
models/llama/index.md
models/minimax/index.md
Expand Down
8 changes: 6 additions & 2 deletions docs/models/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,10 +17,13 @@ Megatron Bridge conversion, training recipe links, and model-specific notes.
|----------------|---------------------|
| **Bailing** | [Ling 2.0](bailing/ling-2.md) |
| **DeepSeek** | [DeepSeek V2 (deprecated)](deepseek/deepseek-v2.md), [DeepSeek V3](deepseek/deepseek-v3.md), [DeepSeek V4](deepseek/deepseek-v4.md) |
| **ERNIE** | [ERNIE 4.5 and ERNIE 4.5 VL](ernie/ernie45.md) |
| **EXAONE** | [EXAONE 4, EXAONE 4.5 VL, and K-EXAONE](exaone/exaone.md) |
| **Falcon** | [Falcon H1](falcon/falcon-h1.md) |
| **Gemma** | [Gemma (deprecated)](gemma/gemma.md), [Gemma 2 (deprecated)](gemma/gemma2.md), [Gemma 3](gemma/gemma3.md), [Gemma 3 VL](gemma/gemma3-vl.md), [Gemma 4 VL](gemma/gemma4-vl.md) |
| **GLM** | [GLM 4.5](glm/glm45.md), [GLM-4.5V](glm/glm-45v.md), [GLM-4.7 / 4.7-Flash](glm/glm47.md), [GLM-5 / 5.1](glm/glm5.md) |
| **GLM** | [GLM-4.5](glm/glm45.md), [GLM-4.5V](glm/glm-45v.md), [GLM-4.7 / GLM-4.7-Flash](glm/glm47.md), [GLM-5 / GLM-5.1 / GLM-5.2](glm/glm5.md) |
| **GPT-OSS** | [GPT OSS](gpt_oss/gpt-oss.md) |
| **HY V3** | [HY V3](hy_v3/hy-v3.md) |
| **Kimi** | [Kimi K2](kimi/kimi-k2.md), [Kimi-K2.5-VL](kimi/kimi-k25-vl.md) |
| **Llama** | [Llama 2 (deprecated)](llama/llama2.md), [Llama 3](llama/llama3.md) |
| **MiniMax** | [MiniMax-M2 / M2.5 / M2.7](minimax/minimax-m2.md), [MiniMax-M3](minimax/minimax-m3.md) |
Expand Down Expand Up @@ -65,12 +68,13 @@ Each model documentation page typically includes:

### Decoder-Only and Hybrid Backbones

- Bailing, DeepSeek, Falcon, Gemma, GLM, GPT-OSS, Kimi, Llama, MiniMax, Mistral, Moonlight, Nemotron, OLMoE, Qwen, Sarvam, StepFun, and Xiaomi-MiMo
- Bailing, DeepSeek, ERNIE, EXAONE, Falcon, Gemma, GLM, GPT-OSS, HY V3, Kimi, Llama, MiniMax, Mistral, Moonlight, Nemotron, OLMoE, Qwen, Sarvam, StepFun, and Xiaomi-MiMo
- MoE and hybrid variants including Bailing, DeepSeek, GLM, GPT-OSS, MiniMax, Nemotron-3, OLMoE, Qwen3-MoE, Qwen3-Next, and Sarvam

### Multimodal Variants

- Gemma 3 VL and Gemma 4 VL
- ERNIE 4.5 VL and EXAONE 4.5 VL
- GLM-4.5V
- Kimi-K2.5-VL
- Ministral 3
Expand Down
20 changes: 20 additions & 0 deletions docs/models/ernie/ernie45.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# ERNIE 4.5

Megatron Bridge registers Hugging Face conversion support for the text-only
`baidu/ERNIE-4.5-0.3B-PT` MoE model and the
`baidu/ERNIE-4.5-VL-28B-A3B-Instruct` and `baidu/ERNIE-4.5-VL-28B-A3B-Thinking`
vision-language MoE models.

Import a text checkpoint with the shared conversion CLI:

```bash
./scripts/conversion/convert.sh import \
--hf-model baidu/ERNIE-4.5-0.3B-PT \
--megatron-path /workspace/models/ernie-4.5-0.3b \
--trust-remote-code
```

For ERNIE 4.5 VL import, export, and inference commands, see the
[checked-in examples](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/models/vlm/ernie_vl).
The VL bridge supports its modality-specific dual-pool MoE layout; use the
parallelism settings documented with those examples.
18 changes: 18 additions & 0 deletions docs/models/exaone/exaone.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
# EXAONE

Megatron Bridge supports Hugging Face conversion for EXAONE 4.0 dense language
models, EXAONE 4.5 vision-language models, and K-EXAONE MoE language models.
Checked-in H100 recipes cover EXAONE 4.0 1.2B, EXAONE 4.5 VL 33B,
K-EXAONE-236B-A23B, and K-EXAONE 2.0 750B-A37B.

Use the model-specific examples for commands and supported parallelism:

- [EXAONE 4.0](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/models/exaone/exaone4)
- [EXAONE 4.5 VL](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/models/exaone/exaone45)
- [K-EXAONE MoE](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/models/exaone/exaone_moe)

The EXAONE 4.0 and EXAONE 4.5 examples use the shared
`scripts/conversion/convert.sh import` entry point. The K-EXAONE examples use
their model-specific distributed round-trip workflows. K-EXAONE 2.0 also has a checked-in
[model verification card](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/model_verification_cards/k-exaone-2/card.yaml)
that records the current verification status of individual workflows.
8 changes: 4 additions & 4 deletions docs/models/glm/glm5.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,14 @@
# GLM-5 and GLM-5.1
# GLM-5, GLM-5.1, and GLM-5.2

[GLM-5](https://huggingface.co/zai-org/GLM-5) and [GLM-5.1](https://huggingface.co/zai-org/GLM-5.1) are large sparse MoE language models with Multi-Latent Attention and Dynamic Sparse Attention. Megatron Bridge supports both checkpoints through the shared `GLM5Bridge`.
[GLM-5](https://huggingface.co/zai-org/GLM-5), [GLM-5.1](https://huggingface.co/zai-org/GLM-5.1), and [GLM-5.2](https://huggingface.co/zai-org/GLM-5.2) are large sparse MoE language models with Multi-Latent Attention and Dynamic Sparse Attention. Megatron Bridge supports these checkpoints through the shared `GLM5Bridge`.

## Supported Variants

| Variant | Hugging Face ID | Notes |
|---------|-----------------|-------|
| GLM-5 | `zai-org/GLM-5` | MoE + MLA + DSA architecture |
| GLM-5.1 | `zai-org/GLM-5.1` | Same architecture and mapping shape as GLM-5 |
| GLM-5.2 | `zai-org/GLM-5.2` | Adds IndexShare-style DSA index reuse settings |

## Architecture Notes

Expand All @@ -20,10 +21,9 @@

## Examples

For conversion, inference, dependency notes, hardware requirements, and MCore patch requirements, see the [GLM-5 examples README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/glm/glm5/README.md).
For the pinned checkpoint revision, tested topology, commands, and expected results for verified GLM-5.2 workflows, see the [GLM-5.2 model verification card](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/model_verification_cards/glm5-2/card.yaml). For the GLM-5 conversion wrapper, dependency notes, and architecture constraints, see the [GLM-5 examples README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/glm/glm5/README.md).

## Related Implementation

- Bridge implementation: [`src/megatron/bridge/models/glm_moe_dsa/glm5_bridge.py`](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/src/megatron/bridge/models/glm_moe_dsa/glm5_bridge.py)
- Examples: [`examples/models/glm/glm5`](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/models/glm/glm5)

6 changes: 3 additions & 3 deletions docs/models/glm/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ glm5.md

| Variant | Guide |
|---------|-------|
| GLM 4.5 | [glm45.md](glm45.md) |
| GLM-4.5 | [glm45.md](glm45.md) |
| GLM-4.5V | [glm-45v.md](glm-45v.md) |
| GLM-4.7 / 4.7-Flash | [glm47.md](glm47.md) |
| GLM-5 / 5.1 | [glm5.md](glm5.md) |
| GLM-4.7 / GLM-4.7-Flash | [glm47.md](glm47.md) |
| GLM-5 / GLM-5.1 / GLM-5.2 | [glm5.md](glm5.md) |
27 changes: 27 additions & 0 deletions docs/models/hy_v3/hy-v3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# HY V3

Megatron Bridge registers Hugging Face checkpoint conversion for the
`tencent/Hy3-preview-Base` MoE causal language model. The bridge maps HY V3's
GQA with QK layer normalization, dense-first layer schedule, sigmoid router,
shared experts, and grouped-GEMM routed experts to Megatron Core.

Import the checkpoint with the shared conversion CLI:

```bash
./scripts/conversion/convert.sh import \
--hf-model tencent/Hy3-preview-Base \
--megatron-path /workspace/models/hy3-preview-base \
--trust-remote-code
```

Export a converted checkpoint back to Hugging Face format:

```bash
./scripts/conversion/convert.sh export \
--hf-model tencent/Hy3-preview-Base \
--megatron-path /workspace/models/hy3-preview-base/iter_0000000 \
--hf-path /workspace/models/hy3-preview-base-hf \
--trust-remote-code
```

No library training recipe is currently exported for HY V3.
1 change: 1 addition & 0 deletions docs/models/mimo/mimo.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ Megatron Bridge supports Hugging Face checkpoints using the `MiMoForCausalLM` ar
Checkpoint conversion and text-generation examples for MiMo causal language
models live under
[`examples/models/mimo`](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/6a706b1c3afab4d21a6f5dd88aa6a75296d33fe2/examples/models/mimo/README.md).
For MiMo-V2-Flash conversion and inference examples, see the [MiMo-V2-Flash examples README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/mimo_v2_flash/README.md).
Heterogeneous multimodal training examples live separately under
[`examples/megatron_mimo`](https://github.com/NVIDIA-NeMo/Megatron-Bridge/tree/main/examples/megatron_mimo).

Expand Down
1 change: 1 addition & 0 deletions docs/models/stepfun/step35.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@
## Examples

For conversion, inference, pretraining, Slurm launch scripts, and MCore branch notes, see the [Step-3.5-Flash examples README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/stepfun/step35/README.md).
For Step 3.7 Flash conversion and training examples, see the [Step 3.7 Flash examples README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/stepfun/step37/README.md).

## Related Implementation

Expand Down
Loading