Repository navigation
Commit a4c2016
authored
File tree
- .github/workflows
- 3rdparty
- docs
- _static/model-verification
- fern/versions
- nightly/pages/models
- beam
- deepseek
- minimax
- nemotron
- models
- beam
- deepseek
- minimax
- nemotron
- examples
- model_verification_cards
- beam
- deepseek-v4-flash
- models
- beam
- diffusion_gemma
- scripts/docs
- skills/create-model-verification-card/scripts
- src/megatron/bridge
- models
- bailing
- beam
- conversion
- glm_vl
- glm
- hy_v3
- mimo
- minimax_m2
- nemotron_omni
- olmoe
- qwen
- recipes
- beam
- h200
- glm/h100
- qwen/h100
- tests
- functional_tests/test_groups/models
- muse_spark_open
- qwen
- unit_tests
- examples
- models
- bailing
- beam
- glm_vl
- glm
- hy_v3
- mimo
- minimax_m2
- minimax_m3
- nemotron_omni
- olmoe
- qwen
- quantization
- recipes
- qwen
- skills/create_model_verification_card
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1384 | 1384 | | |
1385 | 1385 | | |
1386 | 1386 | | |
| 1387 | + | |
| 1388 | + | |
| 1389 | + | |
| 1390 | + | |
| 1391 | + | |
| 1392 | + | |
| 1393 | + | |
| 1394 | + | |
| 1395 | + | |
| 1396 | + | |
| 1397 | + | |
| 1398 | + | |
| 1399 | + | |
| 1400 | + | |
| 1401 | + | |
| 1402 | + | |
| 1403 | + | |
| 1404 | + | |
| 1405 | + | |
| 1406 | + | |
| 1407 | + | |
| 1408 | + | |
| 1409 | + | |
| 1410 | + | |
| 1411 | + | |
| 1412 | + | |
| 1413 | + | |
| 1414 | + | |
| 1415 | + | |
| 1416 | + | |
| 1417 | + | |
| 1418 | + | |
| 1419 | + | |
| 1420 | + | |
| 1421 | + | |
| 1422 | + | |
| 1423 | + | |
| 1424 | + | |
| 1425 | + | |
| 1426 | + | |
| 1427 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 51 files
- megatron/core/dist_checkpointing/exchange_utils.py+145-2
- megatron/core/dist_checkpointing/serialization.py+18-2
- megatron/core/dist_checkpointing/strategies/fully_parallel.py+16
- megatron/core/dist_checkpointing/strategies/torch.py+101-6
- megatron/core/dist_checkpointing/utils.py+125
- megatron/core/distributed/distributed_data_parallel.py+42-2
- megatron/core/distributed/distributed_data_parallel_config.py+14
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/owner_planning.py+3-306
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/parameter_group.py+6-2
- megatron/core/distributed/param_and_grad_buffer.py+134-22
- megatron/core/models/hybrid/shortcut_block.py+3-3
- megatron/core/ssm/wide_residual_mamba_layer.py+20-19
- megatron/core/transformer/custom_layers/batch_invariant_kernels.py+3
- megatron/core/transformer/residual_connection.py+43-33
- megatron/core/transformer/residual_recompute.py+1-5
- megatron/core/transformer/transformer_layer.py+17-13
- megatron/core/transformer/wide_residual_layer.py+83-42
- megatron/training/arguments.py+25
- megatron/training/checkpointing.py+10-1
- megatron/training/config/container.py+31-5
- megatron/training/config/rl_config.py+35-1
- megatron/training/config/training_config.py+11
- megatron/training/initialize.py+3-1
- megatron/training/training.py+14-8
- tests/functional_tests/test_cases/gpt/gpt_dynamic_inference_tp1_pp1_dp4_583m_mxfp8_param_gather_logitsmatch/model_config.yaml+65
- tests/functional_tests/test_cases/gpt/gpt_static_inference_tp1_pp1_583m_fp8_cudagraphs/model_config.yaml+1
- tests/test_utils/recipes/gb200/gpt-dynamic-inference.yaml+5
- tests/unit_tests/determinism/kernels/manifest.py+3-1
- tests/unit_tests/dist_checkpointing/test_stream_ckpt_dequant.py+515
- tests/unit_tests/distributed/mfsdp_v2/test_grad_comm_dtype.py+234
- tests/unit_tests/distributed/mfsdp_v2/test_owner_planning.py+1-127
- tests/unit_tests/generalized_tensor_parallel/test_gtp_grad_correctness.py+1-1
- tests/unit_tests/models/test_shortcut_block.py+19-9
- tests/unit_tests/models/test_wide_residual_mtp_mimo.py+6-5
- tests/unit_tests/rl/test_rl_utils.py+226-5
- tests/unit_tests/ssm/test_hybrid_block.py+5-6
- tests/unit_tests/ssm/test_wide_shortcut_parallel.py+3-4
- tests/unit_tests/test_checkpointing.py+19
- tests/unit_tests/test_fp4_param.py+92
- tests/unit_tests/test_fp8_param.py+93
- tests/unit_tests/training/config/test_config_finalization.py+93
- tests/unit_tests/training/config/test_rl_config.py+135-2
- tests/unit_tests/training/test_inference_initialization.py+8
- tests/unit_tests/training/test_rng_ownership.py+9-2
- tests/unit_tests/transformer/moe/test_wide_residual_branchwise.py+17-10
- tests/unit_tests/transformer/test_residual_connection.py+30-19
- tests/unit_tests/transformer/test_residual_recompute.py+51-57
- tests/unit_tests/transformer/test_te_layers_batch_invariant.py+24
- tests/unit_tests/transformer/test_wide_residual_connection.py+124-94
- tests/unit_tests/transformer/test_wide_residual_cp_sync.py+23-23
- tests/unit_tests/transformer/test_wide_residual_tp_sync.py+11-3
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | | - | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
18 | 20 | | |
19 | 21 | | |
20 | 22 | | |
| |||
230 | 232 | | |
231 | 233 | | |
232 | 234 | | |
| 235 | + | |
233 | 236 | | |
234 | 237 | | |
235 | 238 | | |
| |||
0 commit comments