Skip to content

update failing metrics - #4531

Merged
eder-matheus merged 4 commits into
The-OpenROAD-Project:masterfrom
The-OpenROAD-Project-staging:update_failing_metrics
Sep 11, 2026
Merged

eder-matheus merged 4 commits into
The-OpenROAD-Project:masterfrom
The-OpenROAD-Project-staging:update_failing_metrics

Conversation

@eder-matheus

@eder-matheus eder-matheus commented Sep 11, 2026 •

Copy link
Copy Markdown
Member

asap7/aes

Metric Old New Type
globalroute__timing__setup__tns -339.0 -467.0 Failing
detailedroute__route__wirelength 57763 57175 Tighten
finish__timing__setup__tns -87.7 -191.0 Failing

asap7/aes-block

Metric Old New Type
cts__timing__setup__tns -1890.0 -3080.0 Failing
globalroute__timing__setup__tns -206.0 -331.0 Failing
finish__timing__setup__tns -418.0 -694.0 Failing

gf180/aes-hybrid

Metric Old New Type
cts__timing__setup__ws -1.12 -1.02 Tighten
cts__timing__setup__tns -132.0 -170.0 Failing
globalroute__timing__setup__ws -1.1 -1.06 Tighten
globalroute__timing__setup__tns -144.0 -186.0 Failing
detailedroute__route__wirelength 1477431 1436375 Tighten
finish__timing__setup__ws -1.1 -1.06 Tighten
finish__timing__setup__tns -144.0 -176.0 Failing
finish__design__instance__area 720794 716226 Tighten

gf180/ibex

Metric Old New Type
cts__timing__setup__tns -1450.0 -1280.0 Tighten
cts__timing__hold__ws -1.3 -1.29 Tighten
cts__timing__hold__tns -2.5 -2.49 Tighten
globalroute__timing__setup__ws -1.99 -1.92 Tighten
globalroute__timing__setup__tns -1480.0 -1790.0 Failing
finish__timing__setup__ws -1.97 -1.89 Tighten
finish__timing__setup__tns -1450.0 -1460.0 Failing
finish__timing__hold__ws -1.27 -1.26 Tighten
finish__timing__hold__tns -2.47 -2.46 Tighten

nangate45/aes

Metric Old New Type
globalroute__timing__setup__ws -0.0692 -0.0659 Tighten
globalroute__timing__setup__tns -0.785 -0.963 Failing

sky130hs/ibex

Metric Old New Type
cts__timing__setup__ws -0.35 -0.825 Failing
cts__timing__setup__tns -57.7 -98.8 Failing
globalroute__timing__setup__ws -0.89 -1.48 Failing
globalroute__timing__setup__tns -604.0 -994.0 Failing
finish__timing__setup__ws -0.861 -1.28 Failing
finish__timing__setup__tns -291.0 -761.0 Failing

gf12/ariane

Metric Old New Type
cts__timing__setup__tns -50800.0 -236000.0 Failing

gf12/tinyRocket

Metric Old New Type
placeopt__design__instance__area 14746 14729 Tighten
cts__timing__setup__ws -150.0 -149.0 Tighten
cts__timing__setup__tns -64400.0 -83300.0 Failing
globalroute__timing__setup__ws -163.0 -150.0 Tighten
globalroute__timing__setup__tns -72800.0 -74900.0 Failing
finish__timing__setup__ws -134.0 -126.0 Tighten
finish__timing__setup__tns -42800.0 -40300.0 Tighten
finish__design__instance__area 15322 15300 Tighten

sky130hd/chameleon

Metric Old New Type
cts__timing__setup__ws -2.96 -3.38 Failing
cts__timing__setup__tns -172.0 -276.0 Failing
globalroute__antenna_diodes_count 181 196 Failing
globalroute__timing__setup__ws -2.82 -3.21 Failing
globalroute__timing__setup__tns -151.0 -180.0 Failing
detailedroute__antenna__violating__nets 1 0 Tighten
detailedroute__antenna_diodes_count 162 150 Tighten
finish__timing__setup__ws -2.41 -2.88 Failing
finish__timing__setup__tns -146.0 -165.0 Failing

Signed-off-by: Eder Monteiro <emrmonteiro@precisioninno.com>
Signed-off-by: Eder Monteiro <emrmonteiro@precisioninno.com>
Signed-off-by: Eder Monteiro <emrmonteiro@precisioninno.com>
@eder-matheus eder-matheus self-assigned this Sep 11, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the OpenROAD subproject commit to a newer version. Consequently, it updates the baseline rules and expected metrics (such as netlist hashes, timing slack, total negative slack, wirelength, and design area) across multiple designs and technologies, including asap7, gf12, gf180, nangate45, and sky130hs. No review comments were provided, so there is no feedback to address.

@openroad-ci

openroad-ci commented Sep 11, 2026 •

Copy link
Copy Markdown
Member

🔍 QoR check

Metrics reflect the PR merge build — i.e. what will land on the target branch. Advisory — results are log-only and do not affect build status. The authoritative QoR gate remains the local rules-file check.

Commit a3dac05 · Jenkins build #2 · Baseline: build

62 design(s) checked — 16 with regression(s), 0 without a comparable baseline.
Design Variant Verdict local vs inline passed / failed / missing
asap7/aes base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
asap7/aes-block base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
asap7/aes-mbff base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/aes_lvt base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/cva6 base ✅ pass ✅ MATCH 12 / 0 / 0
asap7/ethmac base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/ethmac_lvt base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/gcd-ccs base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/jpeg_lvt base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/mock-alu base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/mock-cpu base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/riscv32i base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
asap7/riscv32i-mock-sram base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/swerv_wrapper base ✅ pass ✅ MATCH 25 / 0 / 0
asap7/uart base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/aes base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/aes-hybrid base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
gf180/ibex base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
gf180/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/riscv32i base ✅ pass ✅ MATCH 25 / 0 / 0
gf180/uart-blocks base ✅ pass ✅ MATCH 25 / 0 / 0
gt2n/aes base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
gt2n/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
gt2n/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/aes base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/i2c-gpio-expander base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/jpeg base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/riscv32i base ✅ pass ✅ MATCH 25 / 0 / 0
ihp-sg13g2/spi base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/aes base ❌ fail ⚠️ MISMATCH 23 / 2 / 0
nangate45/ariane133 base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
nangate45/ariane136 base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/black_parrot base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/bp_be_top base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/bp_fe_top base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/bp_multi_top base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/cva6 base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/dynamic_node base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/jpeg base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
nangate45/mempool_group base ✅ pass ✅ MATCH 12 / 0 / 0
nangate45/swerv base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/swerv_wrapper base ✅ pass ✅ MATCH 25 / 0 / 0
nangate45/tinyRocket base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
sky130hd/aes base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/chameleon base ❌ fail ⚠️ MISMATCH 18 / 7 / 0
sky130hd/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/ibex base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/jpeg base ❌ fail ⚠️ MISMATCH 24 / 1 / 0
sky130hd/microwatt base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hd/riscv32i base ❌ fail ⚠️ MISMATCH 22 / 3 / 0
sky130hs/aes base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/gcd base ✅ pass ✅ MATCH 25 / 0 / 0
sky130hs/ibex base ❌ fail ⚠️ MISMATCH 20 / 5 / 0
sky130hs/jpeg base ❌ fail ⚠️ MISMATCH 20 / 5 / 0
sky130hs/riscv32i base ✅ pass ✅ MATCH 25 / 0 / 0
❌ asap7/aes base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -115.186 -10.8418 962.4250585696102% -86.8418 PeriodPadding 20%
globalroute__timing__setup__tns -390.817 -92.1409 324.1514897293167% -168.1409 PeriodPadding 20%
❌ asap7/aes-block base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -2989.48 -1801.13 65.97802490658643% -1891.13 PeriodPadding 20%
finish__timing__setup__tns -604.365 -324.642 86.1635278244959% -414.642 PeriodPadding 20%
globalroute__timing__setup__tns -240.514 -116.224 106.9400468061674% -206.224 PeriodPadding 20%
❌ asap7/mock-alu base — 1 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -17851.6 -17349.1 2.8964038480382266% -17409.1 PeriodPadding 20%
❌ asap7/riscv32i base — 1 failing metric(s)
Metric target base delta limit band
globalroute__timing__setup__tns -3367.1 -3079.78 9.329237802700193% -3269.78 PeriodPadding 20%
❌ gf180/aes-hybrid base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -169.893 -118.76 43.055742674301115% -119.36 PeriodPadding 20%
finish__timing__setup__tns -175.169 -128.34 36.488234377434935% -128.94 PeriodPadding 20%
globalroute__timing__setup__tns -185.362 -133.384 38.96869189707911% -133.984 PeriodPadding 20%
❌ gf180/ibex base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -1274.76 -1210.44 5.313770199266383% -1212.04 PeriodPadding 20%
finish__timing__setup__tns -1456.3 -1444.11 0.8441185228272085% -1445.71 PeriodPadding 20%
globalroute__timing__setup__tns -1492.5 -1475.64 1.142555094738554% -1477.24 PeriodPadding 20%
❌ gt2n/aes base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__hold__tns -723.061 -514.415 40.5598592576033% -614.415 PeriodPadding 20%
globalroute__timing__hold__tns -723.061 -514.415 40.5598592576033% -614.415 PeriodPadding 20%
❌ nangate45/aes base — 2 failing metric(s)
Metric target base delta limit band
finish__timing__setup__tns -0.327989 -0.0601417 445.3603739169329% -0.2241417 PeriodPadding 20%
globalroute__timing__setup__tns -0.798938 -0.316552 152.3876014051404% -0.480552 PeriodPadding 20%
❌ nangate45/ariane133 base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -569.485 -522.547 8.982541283367812% -523.147 PeriodPadding 20%
finish__timing__setup__tns -682.468 -588.553 15.956931661209781% -589.153 PeriodPadding 20%
globalroute__timing__setup__tns -701.004 -634.791 10.430677183513945% -635.391 PeriodPadding 20%
❌ nangate45/jpeg base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -45.2272 -38.3599 17.902288587822177% -38.5599 PeriodPadding 20%
finish__timing__setup__tns -44.2441 -39.5173 11.96134351284121% -39.7173 PeriodPadding 20%
globalroute__timing__setup__tns -52.7285 -47.1573 11.814077565933589% -47.3573 PeriodPadding 20%
❌ nangate45/tinyRocket base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -33.2806 -22.2673 49.459521360919375% -22.5073 PeriodPadding 20%
finish__timing__setup__tns -36.1403 -35.7636 1.053305595633549% -36.0036 PeriodPadding 20%
globalroute__timing__setup__tns -41.646 -35.1151 18.598551620243143% -35.3551 PeriodPadding 20%
❌ sky130hd/chameleon base — 7 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -275.775 -171.306 60.98385345522048% -171.906 PeriodPadding 20%
cts__timing__setup__ws -3.22503 -2.80709 14.888728184703732% -2.95709 PeriodPadding 5.0%
finish__timing__setup__tns -164.165 -145.049 13.178994684554874% -145.649 PeriodPadding 20%
finish__timing__setup__ws -2.73404 -2.25574 21.203684821832304% -2.40574 PeriodPadding 5.0%
globalroute__antenna_diodes_count 196 181 8.287292817679559% 181.181 Metric 0.1%
globalroute__timing__setup__tns -179.01 -150.876 18.647100930565497% -151.476 PeriodPadding 20%
globalroute__timing__setup__ws -3.06145 -2.67443 14.471120949136825% -2.82443 PeriodPadding 5.0%
❌ sky130hd/jpeg base — 1 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -124.882 -122.743 1.7426655695233129% -123.743 PeriodPadding 20%
❌ sky130hd/riscv32i base — 3 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -76.1341 -60.821 25.177323621775372% -62.021 PeriodPadding 20%
finish__timing__setup__tns -53.4442 -43.2732 23.504154996626088% -44.4732 PeriodPadding 20%
globalroute__timing__setup__tns -112.566 -103.769 8.47748364154998% -104.969 PeriodPadding 20%
❌ sky130hs/ibex base — 5 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -97.4848 -56.4332 72.74370406073021% -57.7332 PeriodPadding 20%
finish__timing__setup__tns -759.317 -289.801 162.0132435705881% -291.101 PeriodPadding 20%
finish__timing__setup__ws -0.957144 -0.536426 78.42983002315324% -0.861426 PeriodPadding 5.0%
globalroute__timing__setup__tns -993.134 -602.407 64.86096609103149% -603.707 PeriodPadding 20%
globalroute__timing__setup__ws -1.15203 -0.765967 50.4020408189909% -1.090967 PeriodPadding 5.0%
❌ sky130hs/jpeg base — 5 failing metric(s)
Metric target base delta limit band
cts__timing__setup__tns -39.9327 -29.1572 36.95656647414704% -29.8572 PeriodPadding 20%
finish__timing__setup__tns -81.2765 -38.9333 108.75831229307559% -39.6333 PeriodPadding 20%
finish__timing__setup__ws -0.467383 -0.231825 101.61026636471476% -0.406825 PeriodPadding 5.0%
globalroute__antenna_diodes_count 169 35 382.85714285714283% 100 Metric 0.1%
globalroute__timing__setup__tns -185.187 -133.983 38.21678869707351% -134.683 PeriodPadding 20%

Signed-off-by: Eder Monteiro <emrmonteiro@precisioninno.com>
@eder-matheus
eder-matheus merged commit cd435f0 into The-OpenROAD-Project:master Sep 11, 2026
12 checks passed
@eder-matheus
eder-matheus deleted the update_failing_metrics branch September 11, 2026 21:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants