Skip to content

Commit e2f2496

Browse files
feat(model): add Muse-Spark-Open-816B-A42B support with GB200 recipes and HybridEP (#6483)
Signed-off-by: Kamran Jafari <kjafarisadeg@nvidia.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
1 parent 283f238 commit e2f2496

40 files changed

Lines changed: 5229 additions & 10 deletions

File tree

‎README.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,8 @@
1111
</div>
1212

1313
## 📣 News
14+
- [10/15/2026] [**Muse-Spark-Open-816B-A42B**](examples/models/muse_spark_open/README.md) is now supported! Megatron Bridge adds checkpoint conversion, inference, and GB200 training recipes for the 816B-total / 42B-active vision-and-audio-language MoE model: pretraining, full SFT, long-context SFT at 32K and 64K with context parallelism, LoRA, and image-text SFT and LoRA, with HybridEP MoE dispatch. See the [examples README](examples/models/muse_spark_open/README.md) and the [verification card](examples/model_verification_cards/muse-spark-open-816b-a42b/card.yaml) for details.
15+
1416
- [08/19/2026] **Megatron Bridge 0.6.0 released!** Highlights include GLM-5.2 with cuDNN fused DSA for 128K THD-packed context-parallel training, new LLM/VLM/diffusion models, more reliable VLM data and sequence packing, improved checkpoint and LoRA workflows, unified training and conversion launchers, and refreshed performance recipes. Huge thanks to our community contributors! See the [full release notes](https://github.com/NVIDIA-NeMo/Megatron-Bridge/releases/tag/v0.6.0).
1517

1618
- [08/11/2026] **NVIDIA Nemotron 3.5 Lightning is released!** Read the technical blog [here](https://developer.nvidia.com/blog/nvidia-nemotron-3-5-lightning-delivers-fast-accurate-specialized-task-execution-for-long-running-agents/). See the [Nemotron 3.5 Lightning README](https://github.com/NVIDIA-NeMo/Megatron-Bridge/blob/main/examples/models/nemotron/nemotron_3_5_lightning/README.md) for details.
@@ -242,6 +244,7 @@ Megatron Bridge provides out-of-the-box bridges and training recipes for a wide
242244
| [**Xiaomi-MiMo**](docs/models/mimo/index.md) | Xiaomi-MiMo, MiMo-V2-Flash |
243245
| [**Moonlight**](docs/models/moonlight/index.md) | Moonlight |
244246
| [**Muse Glimmer**](docs/models/muse_glimmer/muse-glimmer.md) | Muse Glimmer 30B |
247+
| [**Muse Spark Open**](docs/models/muse_spark_open/muse-spark-open.md) | Muse-Spark-Open-816B-A42B |
245248
| [**Nemotron**](docs/models/nemotron/index.md) | Nemotron-3 Nano, Nemotron-3 Super, Nemotron-3 Ultra, Nemotron-3 Nano Omni |
246249
| [**OLMoE**](docs/models/olmoe/index.md) | OLMoE |
247250
| [**Qwen**](docs/models/qwen/index.md) | Qwen2 / Qwen2.5, Qwen3, Qwen3-MoE, Qwen3 Next, Qwen3.5 (dense/MoE), Qwen2.5-VL, Qwen3-VL, Qwen3.5-VL, Qwen3.6-VL, Qwen2 Audio, Qwen2.5-Omni, Qwen3-Omni, Qwen3-ASR |

‎docs/_static/model-verification/catalog-v1.json‎

Lines changed: 352 additions & 0 deletions
Large diffs are not rendered by default.

‎docs/fern/versions/nightly/pages/models/README.mdx‎

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
Choose a model to open its interactive import/export and training configurations. Every option comes directly from an authoritative YAML verification card; independent fields are never combined into synthetic commands.
66

7-
Current inventory: **28 model cards** and **401 concrete configurations**.
7+
Current inventory: **29 model cards** and **413 concrete configurations**.
88

99
Each model page lets you select import/export, pretraining, benchmarking, SFT, LoRA, or long-context SFT and immediately see the exact command and expected result for the recorded precision and GPU.
1010

@@ -72,13 +72,17 @@ Choose a model to inspect its recorded import/export, training, and precision co
7272
<section class="verification-provider-card">
7373
<header class="verification-provider-heading">
7474
<strong>Meta</strong>
75-
<span>1 model</span>
75+
<span>2 models</span>
7676
</header>
7777
<div class="verification-provider-models">
7878
<a class="verification-model-link" href="muse_glimmer/muse-glimmer#verified-muse-glimmer-30b">
7979
<strong title="meta-models/Muse-Glimmer-30B">Muse-Glimmer-30B</strong>
8080
<span class="verification-status verification-status--partial" title="Partial">◐ Partial</span>
8181
</a>
82+
<a class="verification-model-link" href="muse_spark_open/muse-spark-open#verified-muse-spark-open-816b-a42b">
83+
<strong title="meta-models/Muse-Spark-Open-816B-A42B">Muse-Spark-Open-816B-A42B</strong>
84+
<span class="verification-status verification-status--partial" title="Partial">◐ Partial</span>
85+
</a>
8286
</div>
8387
</section>
8488
<section class="verification-provider-card">

‎docs/fern/versions/nightly/pages/models/muse_spark_open/muse-spark-open.mdx‎

Lines changed: 395 additions & 0 deletions
Large diffs are not rendered by default.

‎docs/index.md‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -52,6 +52,7 @@ models/mistral/index.md
5252
models/mimo/index.md
5353
models/moonlight/index.md
5454
models/muse_glimmer/muse-glimmer.md
55+
models/muse_spark_open/muse-spark-open.md
5556
models/nemotron/index.md
5657
models/olmoe/index.md
5758
models/qwen/index.md

‎docs/models/README.md‎

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
Choose a model to open its interactive import/export and training configurations. Every option comes directly from an authoritative YAML verification card; independent fields are never combined into synthetic commands.
66

7-
Current inventory: **28 model cards** and **401 concrete configurations**.
7+
Current inventory: **29 model cards** and **413 concrete configurations**.
88

99
Each model page lets you select import/export, pretraining, benchmarking, SFT, LoRA, or long-context SFT and immediately see the exact command and expected result for the recorded precision and GPU.
1010

@@ -72,13 +72,17 @@ Choose a model to inspect its recorded import/export, training, and precision co
7272
<section class="verification-provider-card">
7373
<header class="verification-provider-heading">
7474
<strong>Meta</strong>
75-
<span>1 model</span>
75+
<span>2 models</span>
7676
</header>
7777
<div class="verification-provider-models">
7878
<a class="verification-model-link" href="muse_glimmer/muse-glimmer.html#verified-muse-glimmer-30b">
7979
<strong title="meta-models/Muse-Glimmer-30B">Muse-Glimmer-30B</strong>
8080
<span class="verification-status verification-status--partial" title="Partial">◐ Partial</span>
8181
</a>
82+
<a class="verification-model-link" href="muse_spark_open/muse-spark-open.html#verified-muse-spark-open-816b-a42b">
83+
<strong title="meta-models/Muse-Spark-Open-816B-A42B">Muse-Spark-Open-816B-A42B</strong>
84+
<span class="verification-status verification-status--partial" title="Partial">◐ Partial</span>
85+
</a>
8286
</div>
8387
</section>
8488
<section class="verification-provider-card">

0 commit comments

Comments
 (0)