Skip to content

Test efficiency phase 2: measured-cost tiers and suite dedup #12589

Description

@backryun

Follow-up of #12539 (phase 1 landed as #12588: all 4,263 flat tests/unit files relocated into per-prefix subdirs, flat = 0).

Phase 1 findings (measured in worktree)

  • Exact-duplicate files: 0.
  • Shared test names across files: 190 (mostly generic names; a few real overlap candidates, e.g. antigravity usage-fetcher vs usage-service sharing 6+ quota-parsing cases).
  • Cost-signal scan (spawn/sleep/db/net/timing keywords) per top dir: db-touching is pervasive (combo 83, db 102, misc 55 files); spawn concentrates in cli/build/db; only 74 files in 12 dirs are fully signal-free — too small for a meaningful 'quick' tier.
  • Full test:unit single pass exceeds local time budget (killed after 2h at ~25% progress); CI unit gate hits the 4800s ceiling (🔴 Release branch not green: release/v3.8.51 #12581).

Proposed scope

  1. Measure: per-directory wall times (CI reports or sampled local runs) to rank the slowest dirs.
  2. Tier: add an opt-in fast tier (e.g. test:unit:quick = all dirs minus measured-heavy set). Additive only — do not change existing test:unit/CI wiring.
  3. Dedup: merge verified-overlapping suites case by case (starting with the antigravity usage pair), deleting only with passing-suite proof.

Non-goals

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions