|
| 1 | +# Phase 3 — unit of analysis, minimum N, QC-excluded ratios |
| 2 | + |
| 3 | +Decided: 2026-08-18, before any real image was measured. |
| 4 | +Decided by: Sofia. Status: pre-registered; frozen once the first image is |
| 5 | +downloaded. Amendments after that point require a dated entry below stating |
| 6 | +what changed and why, and are themselves part of the record. |
| 7 | + |
| 8 | +## 1. Unit of analysis |
| 9 | + |
| 10 | +DECISION: ratio (one normalized ratio = one point in the ImageJ comparison). |
| 11 | + |
| 12 | +Rationale: blot-level N (8–10 reachable blots) is below Spearman's |
| 13 | +discriminating power — the Gate 1 deferred question "can Spearman discriminate |
| 14 | +at expected N" answers itself as "no" at that N. Ratio-level N≈30 is reachable |
| 15 | +within the time budget and is testable against the pre-registered thresholds |
| 16 | +(>=0.9 / 0.7–0.9 / <0.7). |
| 17 | + |
| 18 | +## 2. Target N, source, and ratio definition |
| 19 | + |
| 20 | +DECISION: 30 ratios from 8–10 blots with >=3 usable lanes each. |
| 21 | + |
| 22 | +Ratio definition (fixed now, before any measurement): |
| 23 | +- Per blot, the reference lane/band is designated at image-selection time, |
| 24 | + from the figure caption alone, before any measurement is run. |
| 25 | +- Each remaining usable lane contributes exactly one ratio to that reference: |
| 26 | + a blot with L usable lanes yields L−1 ratios. No other pairings enter N. |
| 27 | +- Normalization mode per blot is likewise fixed at selection time from the |
| 28 | + caption: a stated loading-control band -> housekeeping; stated stain-based |
| 29 | + loading (Ponceau, total protein stain) -> total_protein. |
| 30 | +- A blot whose caption states neither is REJECTED at selection, not decided |
| 31 | + at measurement time. Guessing the loading control from the data is |
| 32 | + forbidden (consistent with Phase 2 Ruling 2). |
| 33 | + |
| 34 | +Arithmetic check: 8–10 blots × (L−1) >= 2 ratios each gives 16–30+; the |
| 35 | +stopping rule below caps collection, not the definition. |
| 36 | + |
| 37 | +## 3. Non-independence of ratios within a blot |
| 38 | + |
| 39 | +DECISION: disclosed, not corrected. Ratios within one blot share a background |
| 40 | +estimate and an exposure; effective N is below nominal N; any reported |
| 41 | +confidence interval is optimistic. This becomes a DEBT entry when merged into |
| 42 | +the repo. The reported r itself is unaffected; only its uncertainty is |
| 43 | +understated, and that is stated wherever r is stated. |
| 44 | + |
| 45 | +Agreed: Sofia, 2026-08-18. |
| 46 | + |
| 47 | +## 4. QC-excluded ratios in the ImageJ comparison |
| 48 | + |
| 49 | +DECISION: excluded from the correlation; reported as a separate count |
| 50 | +("n excluded by QC", with the flags that excluded them). |
| 51 | + |
| 52 | +Rationale: the correlation measures agreement on numbers the tool certifies. |
| 53 | +Including numbers the tool itself refuses to certify would mix two populations |
| 54 | +and answer neither question. A secondary correlation on flagged ratios was |
| 55 | +considered and rejected: at the expected flagged n (likely <10) it would be |
| 56 | +uninterpretable noise, and reporting an uninterpretable number invites |
| 57 | +misreading it. |
| 58 | + |
| 59 | +Failure mode I accept: QC may leave fewer than 15 surviving ratios. I will |
| 60 | +report that count as a finding in its own right ("QC excluded X of Y ratios |
| 61 | +from N real blots") and will not relax any QC threshold to save N. QC |
| 62 | +thresholds are frozen as shipped (Phase 3 Gate 1); nothing here reopens them. |
| 63 | + |
| 64 | +## 5. Stopping rule |
| 65 | + |
| 66 | +DECISION: collection stops at 30 ratios or 10 blots, whichever comes first. |
| 67 | + |
| 68 | +If fewer than 15 ratios survive QC, the ImageJ correlation is reported with |
| 69 | +the explicit caveat that N is below the pre-registered minimum and the |
| 70 | +agreement claim is downgraded to descriptive (no threshold verdict). The |
| 71 | +survival count itself is reported as a primary finding. Criteria are not |
| 72 | +relaxed to reach 15. |
| 73 | + |
| 74 | +Agreed: Sofia, 2026-08-18. |
| 75 | +## 6. Source image format (recorded before download, 2026-08-18) |
| 76 | + |
| 77 | +Every candidate figure in the Gate 2 shortlist is distributed as JPEG. The |
| 78 | +`lossy_format` QC flag is therefore expected to fire on the entire real-blot |
| 79 | +set. This is reported as a finding about the OA literature — published figures |
| 80 | +do not preserve the acquisition format the measurement should be made on — and |
| 81 | +not treated as grounds to suppress or exempt the flag. |
| 82 | + |
| 83 | +## 7. Pseudocoloured blots (recorded before download, 2026-08-18) |
| 84 | + |
| 85 | +DECISION: a blot panel whose pixels are not single-channel is REJECTED at |
| 86 | +selection; it is not converted to greyscale. |
| 87 | + |
| 88 | +Scope: the rule applies to the CROPPED blot panel, not to the source figure. |
| 89 | +Published figures are montages — coloured bar charts and MW ladders share a |
| 90 | +file with greyscale blot panels — so a whole-figure colour test would reject |
| 91 | +nearly every candidate while saying nothing about the measured region. The |
| 92 | +download step records a whole-figure colour fraction as a screening aid only. |
| 93 | + |
| 94 | +Rationale: choosing an RGB→grey conversion would introduce a measurement |
| 95 | +parameter selected without data to select it. Phase 3's only reference is the |
| 96 | +ImageJ comparison, and ImageJ applies its own conversion; part of any observed |
| 97 | +disagreement would then be attributable to the conversion rather than to the |
| 98 | +method, with no third reference available to separate the two contributions. |
| 99 | + |
| 100 | +Failure mode I accept: fluorescence-detection blots are common, so this may |
| 101 | +remove a substantial share of candidates and push N down. That count is |
| 102 | +reported ("X of Y candidate panels rejected as pseudocoloured") rather than |
| 103 | +recovered by converting. |
| 104 | + |
| 105 | +Carried to backlog, not Phase 3: blotquant should detect non-single-channel |
| 106 | +input and BLOCK with an explanatory message directing the user to the |
| 107 | +scanner's single-channel export, consistent with the three-state QC model |
| 108 | +(pass | flagged | blocked). Silently converting and returning a number is the |
| 109 | +failure mode this project exists to refuse. -> DEBT entry. |
| 110 | + |
| 111 | +## 8. Gate 2 image review — ratified 2026-08-18, after download, before any crop |
| 112 | + |
| 113 | +(a) FINDING: every total-protein stain panel in the downloaded set (Ponceau, |
| 114 | +2 blots) is reproduced in colour. Under §7 these reference panels are not |
| 115 | +single-channel and are excluded; no per-channel extraction is applied. The |
| 116 | +real-blot set is therefore HOUSEKEEPING-ONLY, and the README will state that |
| 117 | +total_protein agreement was not measurable on published figures for this |
| 118 | +reason. Feeds the non_grayscale_source blocking-flag DEBT entry. |
| 119 | + |
| 120 | +(b) Removed at image review: PMC13135388 Figure 1 (reference panel |
| 121 | +pseudocoloured), PMC13019689 Figures 1 and 3 (Ponceau reference in colour), |
| 122 | +PMC13138064 Figure 4 (2 lanes, below the >=3 minimum — visible only in the |
| 123 | +image, not the caption). Retained with restriction: PMC13135388 Figure 4, |
| 124 | +panels TIGAR + vinculin only (adjacent Parkin panel is pseudocoloured; §7 |
| 125 | +applies to the cropped panel). Retained: PMC12956003 Figure 2 (Pon S panel is |
| 126 | +coloured but is not the designated reference; α-tubulin is, and is greyscale). |
| 127 | + |
| 128 | +(c) Borderline-resolution rule: no figure is excluded by eye for band size. |
| 129 | +All remaining figures are cropped; the crop's measured pixel height decides |
| 130 | +against the pre-registered >=15 px band-height minimum. Selection by |
| 131 | +measurement, not by impression. |
| 132 | + |
| 133 | +## 9. Crop rule — fixed before the first crop, 2026-08-18 |
| 134 | + |
| 135 | +- One crop = one blot panel: the rectangle bounds the panel's lanes, full lane |
| 136 | + height, plus >=10 px background margin on every side where the montage |
| 137 | + allows it. |
| 138 | +- The crop must include the panel's designated reference band row if the |
| 139 | + reference shares the panel; if the reference is a separate strip (e.g. |
| 140 | + loading-control row below), it is cropped as part of the same rectangle |
| 141 | + whenever they are vertically contiguous in the figure, else as a second |
| 142 | + rectangle recorded against the same blot_id. |
| 143 | +- Annotation overlays (arrows, kDa markers, labels) may remain if they sit |
| 144 | + outside lane boundaries; a crop where annotation touches a measured lane is |
| 145 | + rejected. |
| 146 | +- No rotation, no rescaling, no level/contrast adjustment, no resampling. |
| 147 | + Export as PNG (lossless container; the source pixels are already JPEG and |
| 148 | + are not re-encoded into further loss). |
| 149 | +- Every crop records: parent file, parent sha256, crop rectangle is NOT |
| 150 | + recorded manually — the crop file's own sha256 and pixel size are recorded |
| 151 | + at creation by the logging step, and the parent linkage makes the crop |
| 152 | + auditable against its source. |
| 153 | +- ImageJ runs on the SAME crop file, byte-identical, never on its own crop. |
| 154 | + |
| 155 | +## 10. Gate 2 CLOSED — 2026-08-18 |
| 156 | + |
| 157 | +Real-image list approved by Sofia. The approved set is exactly the rows of |
| 158 | +crops/crop_log.csv at this timestamp; provenance (DOI, licence, sha256 of crop |
| 159 | +and parent) recorded per image in images/provenance.md and crops/crop_log.csv. |
| 160 | +Housekeeping-only per §8(a). Borderline crops enter measurement; the >=15 px |
| 161 | +band-height minimum and lane-width reality decide there, per §8(c). |
| 162 | + |
| 163 | +## 11. §7 verified mechanically on crops — 2026-08-18 |
| 164 | + |
| 165 | +Colour fraction measured on all 19 crops after Gate 2 closure: 13 crops at |
| 166 | +0.0000, 5 between 0.0034 and 0.0068 (labels and kDa markers, not bands), |
| 167 | +maximum 0.0158 (PMC13135388_Figure4__E-Vinculin, adjacent to the |
| 168 | +pseudocoloured Parkin panel). All below the 0.02 screening threshold. The §7 |
| 169 | +single-channel rule is therefore confirmed by measurement, not by eye. |
| 170 | + |
| 171 | +### 11a. Amendment — 2026-08-18, after §11 |
| 172 | + |
| 173 | +PMC13135388_Figure4__E-Vinculin was re-cropped: the original rectangle |
| 174 | +included the lower edge of the adjacent pseudocoloured Parkin panel |
| 175 | +(colour fraction 0.0158). The band region was unaffected, but that edge sits |
| 176 | +in the background region the pipeline uses for background estimation. The |
| 177 | +re-crop excludes it; measured colour fraction is now 0.0000 and the crop |
| 178 | +sha256 in crop_log.csv is updated accordingly. §11's stated maximum of 0.0158 |
| 179 | +refers to the superseded crop; the current set maximum is 0.0068. |
0 commit comments