Skip to content

Research reproducibility: canonicalize object models and benchmark pairs - #87

Merged
fraware merged 5 commits into
post-freeze-developmentfrom
research/reproducibility-hardening-2026-08-25
Aug 25, 2026
Merged

fraware merged 5 commits into
post-freeze-developmentfrom
research/reproducibility-hardening-2026-08-25

Conversation

@fraware

@fraware fraware commented Aug 25, 2026

Copy link
Copy Markdown
Owner

Post-freeze research/software hardening only. No empirical main changes and no physical-validation claim.

This PR makes repeated-observation research artifacts deterministic under permutation of their input sets:

  • canonicalizes observation ordering before incremental Acoustic Object Model clustering;
  • makes the model's display specimen ID and source-observation ordering deterministic even when callers vary casing/order;
  • uses the canonical model specimen ID in Sonic Twin index entries;
  • canonicalizes nuisance characterization pair orientation and ordering;
  • rejects duplicate nuisance observation IDs rather than silently producing ambiguous pairs;
  • canonicalizes hard-negative generation and adds deterministic tie-breakers;
  • canonicalizes benchmark same-specimen and hard-negative pair construction;
  • adds regression tests asserting object-model, index, nuisance, hard-negative, and benchmark-pair permutation invariance.

No scoring weights, recurrence thresholds, DSP estimator, evidence schema, empirical Gate semantics, material claim, or calibrated identity claim is changed. The purpose is reproducibility: the same observation set must produce the same research artifacts regardless of caller iteration order.

@fraware
fraware merged commit 6d9a6c5 into post-freeze-development Aug 25, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant