Repository navigation
Commit f051cef
File tree
- 3rdparty
- docs
- _static/model-verification
- fern
- versions
- 0.4.2/pages
- models/llm
- nightly/pages
- models
- deepseek
- glm
- nemotron
- qwen
- models
- deepseek
- gemma
- glm
- nemotron
- qwen
- examples
- conversion/compare_hf_and_megatron
- model_verification_cards
- deepseek-v4-flash
- glm5-2
- glm5
- nemotron-3-nano-omni-30b-a3b-reasoning
- qwen3.6-35b-a3b
- models
- diffusion_gemma
- nemotron
- nemotron_3_5_lightning
- nemotron_3_5_super_vl
- nemotron_3_nano_omni
- nemotron_3_nano
- nemotron_3_super
- nemotron_3_ultra
- nemotron_3
- nemotron_vl
- conf
- scripts
- conversion
- docs
- inference
- performance
- utils
- skills
- create-model-verification-card/scripts
- nemo-mbridge-perf-vision-dp-over-cp
- src/megatron/bridge
- data
- diffusion/models/nemotron_labs_diffusion
- models
- conversion
- diffusion_gemma
- gemma_vl
- gemma
- glm_moe_dsa
- kimi
- ministral3/data
- qwen3_asr/hf_qwen3_asr
- qwen
- peft
- perf_recipes
- glm_moe_dsa
- gb200
- h100
- nemotronh
- gb200
- gb300
- vr200
- qwen_vl
- gb300
- vr200
- recipes
- diffusion_gemma
- glm
- gb200
- h100
- moonlight/h100
- qwen/h100
- training
- utils
- utils
- tests
- functional_tests
- launch_scripts/h100/active
- test_groups/models
- diffusion_gemma
- glm_moe_dsa
- unit_tests
- conversion/launcher
- data
- collators
- doc_consistency
- examples
- models
- diffusion_gemma
- glm_moe_dsa
- kimi
- qwen3_asr
- qwen
- peft
- recipes
- qwen
- scripts/performance
- skills/create_model_verification_card
- training
- megatron_mimo
- utils
- utils
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 53 files
- .github/workflows/cicd-approve-test-queue.yml+23-5
- docs/index.md+1-1
- docs/mcore-inference-user-guide.md+1-1
- docs/user-guide/observability/index.md+6-10
- examples/inference/advanced/vlm_dynamic_inference.py+1-4
- megatron/core/distributed/fsdp/mcore_fsdp_adapter.py+19-13
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/fully_shard.py+6
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/layout.py+9-8
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/module.py+39-3
- megatron/core/distributed/param_and_grad_buffer.py+13
- megatron/core/fusions/fused_softmax.py+1
- megatron/core/inference/moe/batch_invariant.py+1-1
- megatron/core/inference/utils.py+5-3
- megatron/core/models/gpt/gpt_layer_specs.py+3-1
- megatron/core/optimizer/cpu_offloading/hybrid_optimizer.py+3-1
- megatron/core/parallel_state.py+1-1
- megatron/core/resharding/copy_services/nccl_m2n_copy_service.py+9-3
- megatron/core/transformer/moe/experts.py+15-8
- megatron/core/transformer/moe/fused_a2a.py+4
- megatron/core/transformer/moe/moe_utils.py-3
- megatron/rl/rl_utils.py+13
- megatron/training/models/dist_utils.py+1-1
- megatron/training/training.py+1-1
- skills/mcore-build-and-dependency/SKILL.md+1-2
- skills/mcore-bump-base-image/SKILL.md+1-2
- skills/mcore-cicd/SKILL.md+1-2
- skills/mcore-create-issue/SKILL.md+2-4
- skills/mcore-linting-and-formatting/SKILL.md+1-2
- skills/mcore-migrate-gpt-to-hybrid/SKILL.md+1-2
- skills/mcore-onboard-gb200-1node-tests/SKILL.md+2-4
- skills/mcore-run-on-slurm/SKILL.md+1-2
- skills/mcore-split-pr/SKILL.md+2-4
- skills/mcore-testing/SKILL.md+1-2
- skills/nightly-sync/SKILL.md+1-2
- skills/pr-review/SKILL.md+4-4
- skills/respond-to-issue/SKILL.md+2-4
- tests/unit_tests/determinism/kernels/manifest.py+6-2
- tests/unit_tests/determinism/kernels/test_inference_kernels.py+8
- tests/unit_tests/determinism/kernels/test_tensor_parallel_kernels.py+34
- tests/unit_tests/distributed/mfsdp_v2/mcore_training_utils.py+37
- tests/unit_tests/distributed/mfsdp_v2/test_fully_shard.py+4-6
- tests/unit_tests/distributed/mfsdp_v2/test_mcore_adapter.py+291-82
- tests/unit_tests/distributed/test_param_storage_copyback.py+95
- tests/unit_tests/fusions/test_fused_softmax_swa_mask.py+40
- tests/unit_tests/inference/test_inference_utils.py+30-1
- tests/unit_tests/inference/test_mimo_checkpoint_inference.py+1-3
- tests/unit_tests/inference/test_vllm_fused_moe_batch_invariant.py+15
- tests/unit_tests/resharding/test_nccl_m2n_copy_service.py+31-7
- tests/unit_tests/test_optimizer_cpu_offloading.py+50
- tests/unit_tests/transformer/moe/test_grouped_mlp.py+138-21
- tests/unit_tests/transformer/test_multi_latent_attention.py+106
- tools/run_dynamic_text_generation_server.py+8-8
- uv.lock+2.7k-2.1k
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
34 | | - | |
| 34 | + | |
35 | 35 | | |
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | | - | |
| 40 | + | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
| |||
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
58 | | - | |
| 58 | + | |
59 | 59 | | |
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
64 | | - | |
| 64 | + | |
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
| |||
0 commit comments