Repository navigation
Commit 368659c
authored
File tree
- 3rdparty
- tests/unit_tests/models/qwen_vl/modelling_qwen3_vl
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 65 files
- .github/workflows/cicd-main.yml+11
- .github/workflows/process-group-usage-check.yml+4
- docker/Dockerfile.ci.dev+3
- examples/rl/benchmark_refit.py+37-27
- examples/rl/model_configs/common.sh+1-1
- megatron/core/context_parallel/sequence_roll.py+143
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/layout.py+19-3
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/owner_planning.py+10-10
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/quantized_dbuffer.py+8-14
- megatron/core/fusions/fused_row_copy.py+94
- megatron/core/inference/contexts/dynamic_context.py+2-1
- megatron/core/inference/engines/dynamic_engine.py+1-2
- megatron/core/inference/text_generation_controllers/mtp_controller_mixin.py+2-2
- megatron/core/inference/text_generation_controllers/text_generation_controller.py+6-12
- megatron/core/inference/utils.py+11
- megatron/core/models/common/utils.py+1-1
- megatron/core/models/gpt/fine_grained_callables.py+1-1
- megatron/core/tensor_parallel/mappings.py+95
- megatron/core/transformer/experimental_attention_variant/csa.py+509-2
- megatron/core/transformer/experimental_attention_variant/csa_utils/cp_utils.py+372
- megatron/core/transformer/experimental_attention_variant/csa_utils/csa_indexer_loss_kernels.py+72
- megatron/core/transformer/experimental_attention_variant/csa_utils/csa_teacher_lse.py+199-35
- megatron/core/transformer/experimental_attention_variant/csa_utils/packed_layout.py+252
- megatron/core/transformer/experimental_attention_variant/csa_utils/packed_sparse_attention.py+727
- megatron/core/transformer/experimental_attention_variant/deepseek_v4_hybrid_attention.py+346-115
- megatron/core/transformer/moe/README.md+1
- megatron/core/transformer/moe/fused_a2a.py+232-1
- megatron/core/transformer/moe/moe_utils.py+2-2
- megatron/core/transformer/moe/token_dispatcher.py+124-1
- megatron/core/transformer/multi_latent_attention.py+17-2
- megatron/core/transformer/multi_token_prediction.py+125-70
- megatron/core/transformer/transformer_config.py+20-12
- megatron/inference/utils.py+1-8
- megatron/rl/inference/megatron.py+58-40
- megatron/rl/rl_utils.py+53-46
- megatron/training/arguments.py+26-85
- megatron/training/checkpointing.py+5-2
- megatron/training/config/container.py+15
- megatron/training/config/inference_config.py+51-18
- megatron/training/config/rl_config.py+55-15
- megatron/training/training.py+67-59
- tests/functional_tests/dynamic_inference_functional_tests.md+2-2
- tests/functional_tests/test_cases/moe/gpt_dynamic_inference_tp4_etp1_pp1_ep8_16B_logitsmatch_zmq_suspend_resume/model_config.yaml+2-2
- tests/unit_tests/determinism/kernels/manifest.py+29-1
- tests/unit_tests/determinism/kernels/test_csa_packed_kernels.py+100
- tests/unit_tests/determinism/kernels/test_fused_triton_kernels.py+95-1
- tests/unit_tests/determinism/kernels/test_moe_kernels.py+22-4
- tests/unit_tests/distributed/mfsdp_v2/test_owner_planning.py+36-32
- tests/unit_tests/fusions/test_fused_row_copy.py+42
- tests/unit_tests/inference/test_inference_config.py+102-21
- tests/unit_tests/inference/test_inference_utils.py+24-1
- tests/unit_tests/inference/text_generation_controllers/test_mtp_kv_cache_controller.py+1
- tests/unit_tests/rl/test_rl_utils.py+24-11
- tests/unit_tests/rl/test_rollout_generation.py+1-1
- tests/unit_tests/test_check_process_group_usage.py-12
- tests/unit_tests/test_eval_batch_size.py-1
- tests/unit_tests/test_training.py+2-3
- tests/unit_tests/training/config/test_rl_config.py+104-8
- tests/unit_tests/transformer/experimental_attention_variant/test_dsv4_hybrid_attention.py+5-3
- tests/unit_tests/transformer/experimental_attention_variant/test_dsv4_packed_cp.py+346
- tests/unit_tests/transformer/moe/test_grouped_tensor_dispatcher_numerics.py+13-8
- tests/unit_tests/transformer/moe/test_token_dispatcher.py+13-3
- tests/unit_tests/transformer/test_contiguous_sequence_roll.py+67
- tests/unit_tests/transformer/test_multi_latent_attention.py+64
- train_rl.py+12-12
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
254 | 254 | | |
255 | 255 | | |
256 | 256 | | |
| 257 | + | |
| 258 | + | |
257 | 259 | | |
258 | 260 | | |
259 | 261 | | |
| |||
0 commit comments