Commit ac8bb10
[misc] allow ATTN_QAT_TRAIN on Wan cross-attention (train/infer parity)
The cross-attn (attn2) LocalAttention allowlist had ATTN_QAT_INFER (added in
hao-ai-lab#1598) but not ATTN_QAT_TRAIN, so QAT finetune silently ran cross-attn in Flash
while self-attn fake-quantized — a train/inference mismatch vs the FP4 inference
path (which quantizes both). Add ATTN_QAT_TRAIN so the finetune fake-quantizes
cross-attn too. (self-attn already had it via the DiT config list.)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1 parent 113ef13 commit ac8bb10
1 file changed
Lines changed: 2 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
186 | 186 | | |
187 | 187 | | |
188 | 188 | | |
189 | | - | |
| 189 | + | |
| 190 | + | |
190 | 191 | | |
191 | 192 | | |
192 | 193 | | |
| |||
0 commit comments