Repository navigation
Commit e1e551b
authored
Arm backend: Relax DeepSeek VGF BF16 abs tolerance (pytorch#22644)
The xlarge DeepSeek VGF BF16 test is numerically stable in its mean
error but exceeds the existing 0.1 absolute tolerance across platforms
and random seeds.
| Platform | Seed | Result | Max |Δ| | Mean |Δ| |
|-----------|------|--------|----------|----------|
| Ubuntu x86| 0 | Fail | 0.140625 | 0.026189 |
| Ubuntu x86| 1 | Fail | 0.150391 | 0.026114 |
| Ubuntu x86| 2 | Fail | 0.134766 | 0.025801 |
| macOS | 0 | Fail | 0.156250 | 0.025820 |
| macOS | 1 | Fail | 0.153320 | 0.025708 |
| macOS | 2 | Pass | — | — |
Raise atol from 0.1 to 0.17, providing modest headroom above the largest
observed difference while retaining rtol=0.1.
The exact test passes on Ubuntu x86 with seeds 0, 1, and 2 after this
change.
cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils
@Sebastian-Larsson @robell @rascani
Signed-off-by: Sangwon Ha <sangwon.ha@arm.com>1 parent dc8c578 commit e1e551b
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
200 | | - | |
| 200 | + | |
201 | 201 | | |
202 | 202 | | |
203 | 203 | | |
| |||
0 commit comments