Commit 1986b1f
committed
[docs] attn_only: note it only saves attention for dispatcher-visible backends
The MUST_SAVE policy runs via __torch_dispatch__, so it only sees the
attention forward when it is a registered op (torch SDPA, FA4/cute). The
flash_attn-library FA2/FA3 training forward routes to the raw external func
(opaque to SAC), so its attention is recomputed — correct, but no speedup
over FULL for that backend. Document the caveat; no behavior change.1 parent 8e18bc3 commit 1986b1f
1 file changed
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
130 | 130 | | |
131 | 131 | | |
132 | 132 | | |
133 | | - | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
134 | 138 | | |
135 | 139 | | |
136 | 140 | | |
| |||
0 commit comments