Repository navigation
Commit d3af42b
committed
test(model): drop MTP from the EXAONE MoE toy checkpoint
ExaoneMoeForCausalLM declares _keys_to_ignore_on_load_unexpected = [r"mtp.*"], so
released checkpoints carry MTP weights but the modelling class does not build them. A
toy constructed from that class with num_nextn_predict_layers set therefore saves no
MTP weights, while the provider still builds MTP layers and the bridge still registers
the MTP mappings off the same config value.
Those layers were being compared without ever having been loaded. The new mapping
validation reports them as missing instead, which is correct. Drop MTP from the toy so
it represents something the class can actually produce.
Verified with the roundtrip the functional test drives, TP=2: 89/89 weights matched.
Signed-off-by: Minho Ryu <ryumin93@gmail.com>1 parent b6a6612 commit d3af42b
1 file changed
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
100 | 100 | | |
101 | 101 | | |
102 | 102 | | |
103 | | - | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
104 | 108 | | |
105 | 109 | | |
106 | 110 | | |
| |||
0 commit comments