Repository navigation
Commit bbd37ba
authored
File tree
- 3rdparty
- tests/functional_tests/launch_scripts/h100/active
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 26 files
- docs/api-guide/core/pipeline_parallel.md+47
- docs/user-guide/deterministic-training.md+7
- docs/user-guide/features/dist_optimizer.md+12
- megatron/core/inference/model_inference_wrappers/abstract_model_inference_wrapper.py+9
- megatron/core/models/gpt/gpt_model.py+9
- megatron/core/models/hybrid/hybrid_block.py+7-1
- megatron/core/models/hybrid/hybrid_model.py+6
- megatron/core/optimizer/distrib_optimizer.py+23-5
- megatron/core/pipeline_parallel/p2p_communication.py+23-34
- megatron/core/pipeline_parallel/schedules.py+19-3
- megatron/core/ssm/gated_delta_net/common.py+34-2
- megatron/core/transformer/transformer_block.py+6
- megatron/core/transformer/transformer_config.py+3-9
- tests/functional_tests/test_cases/hybrid/hybrid_mhc_tp1_pp2_vpp2_empty_mtp/golden_values_dev_dgx_gb200.json+142
- tests/functional_tests/test_cases/hybrid/hybrid_mhc_tp1_pp2_vpp2_empty_mtp/model_config.yaml+70
- tests/functional_tests/test_cases/hybrid/hybrid_mhc_tp2_pp2_mtp/golden_values_dev_dgx_gb200.json+142
- tests/functional_tests/test_cases/hybrid/hybrid_mhc_tp2_pp2_mtp/model_config.yaml+71
- tests/test_utils/recipes/gb200/mamba.yaml+81
- tests/unit_tests/determinism/kernels/test_ssm_kernels.py+35
- tests/unit_tests/inference/model_inference_wrappers/test_abstract_model_inference_wrapper.py+29
- tests/unit_tests/models/test_hybrid_mhc.py+30-1
- tests/unit_tests/optimizer/test_distrib_optimizer_mixed_precision.py+155
- tests/unit_tests/pipeline_parallel/test_pp_mhc_compatibility.py+455
- tests/unit_tests/pipeline_parallel/test_pp_mhc_dsv4_shapes.py+254
- tests/unit_tests/ssm/test_gated_delta_net.py+7-1
- tests/unit_tests/transformer/test_hyper_connection_recompute.py+13-13
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| 18 | + | |
| 19 | + | |
18 | 20 | | |
19 | 21 | | |
20 | | - | |
| 22 | + | |
21 | 23 | | |
22 | 24 | | |
23 | 25 | | |
0 commit comments