Repository navigation
Commit 1ad09d8
test: drop flaky joint-vs-single assertion in LPV multi-dataset test
The final assertion `e1 < e2_only1` was both apples-to-oranges (joint-fit
training error on d1 vs single-d1-fit held-out error on d2) and, even
after fixing the names to `e2 < e2_only1`, would still be flaky: with
σy = 0.005 the noise floor is ~2.5e-5, and both quantities saturate
there because the true LPV system is identical across d1 and d2 and a
2-state, 22-parameter model fit to 1200 samples already recovers θ to
within noise. The "joint beats single" signal does not exist in this
regime — the relative ordering is just BFGS noise.
The remaining assertions (shape of x0_mat, per-dataset MSE bounds)
still validate that the multi-dataset path runs to completion, gives
each dataset its own initial state, and explains both datasets well.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent 970f1cf commit 1ad09d8
1 file changed
Lines changed: 0 additions & 12 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
131 | 131 | | |
132 | 132 | | |
133 | 133 | | |
134 | | - | |
135 | | - | |
136 | | - | |
137 | | - | |
138 | | - | |
139 | | - | |
140 | | - | |
141 | | - | |
142 | | - | |
143 | | - | |
144 | | - | |
145 | | - | |
146 | 134 | | |
147 | 135 | | |
148 | 136 | | |
| |||
0 commit comments