Skip to content

Commit df9d14c

Browse files
Merge #2624 review updates into the GLM-5.3-Flash branch
Keep this branch's live-MTP export, mtp.* rules and KPool indexer export: GLM-5.3-Flash's bridge builds the MTP, so the guard #2624 adds for GLM-5 does not apply here. Takes the DSA test check. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
2 parents bbed2bc + 7dbd1da commit df9d14c

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

‎tests/gpu_megatron/torch/quantization/plugins/test_megatron.py‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1958,6 +1958,11 @@ def _test_dsa_kv_cache_quant_helper(tmp_path, rank, size):
19581958
if ".indexer." in name:
19591959
param.requires_grad_(False)
19601960
sharded_state_dict_test_helper(tmp_path, model, model_test, forward)
1961+
# The helper compares every restored tensor (incl. K/V amax), but V is unused in the forward
1962+
# pass, so also check both quantizers came back enabled.
1963+
restored = [m for m in model_test.modules() if isinstance(m, DSAttention)]
1964+
assert len(restored) == len(dsa_modules)
1965+
assert all(m.k_bmm_quantizer.is_enabled and m.v_bmm_quantizer.is_enabled for m in restored)
19611966

19621967

19631968
def test_dsa_kv_cache_quant(dist_workers_size_1, tmp_path):

0 commit comments

Comments
 (0)