Skip to content

feat: adopt Harbor execution foundation - #10

Merged
nmogil merged 2 commits into
mainfrom
issue-7-harbor-foundation
Jul 11, 2026
Merged

feat: adopt Harbor execution foundation#10
nmogil merged 2 commits into
mainfrom
issue-7-harbor-foundation

Conversation

@nmogil

@nmogil nmogil commented Jul 11, 2026

Copy link
Copy Markdown
Contributor

Summary

  • adopt Harbor 0.18.0 as Mogil Bench's pinned coding-eval execution foundation
  • run one isolated local-Docker trial with a separate no-network hidden verifier
  • retain versioned Mogil-owned evidence bundles with workspace changes, verifier evidence, Harbor locks/results/logs, checksums, and confirmed cleanup
  • preserve reviewer-safe BlindBench eval-record v1 export while marking legacy/final-answer-only evidence non_quality
  • add a mandatory credential-free real Harbor + Docker CI smoke

Security and evidence boundaries

  • Python >=3.12,<3.13, Harbor 0.18.0, and Pi 0.80.6 are exact compatibility pins
  • Harbor runs require explicit --allow-agents, Docker only, one attempt, concurrency 1, retries 0, delete=true, and no mounts
  • candidate and hidden-verifier build contexts are separate; the verifier runs with no network
  • missing/corrupt evidence or unconfirmed cleanup fails closed as insufficient
  • Phase 1 cannot emit quality_eligible
  • hidden canaries, verifier implementation, absolute paths, and raw Harbor SDK payloads are excluded from default BlindBench v1 output

Verification

Independent fresh Python 3.12 environment:

  • pytest -q -m 'not docker_smoke' — 53 passed
  • pytest -q -m docker_smoke tests/test_harbor_docker_smoke.py — 1 passed
  • ruff check . — passed
  • mypy src — passed
  • git diff --check — passed
  • sample JSON/JSONL artifact validation — passed
  • command-adapter regression smoke — passed
  • post-smoke Docker inspection — no leaked Harbor/Mogil containers

The real Docker smoke verifies the known workspace patch, separate verifier reward, retained evidence, checksums, canary non-leakage, and exact observed Compose-label cleanup.

Deliberate follow-ups

Closes #7

@nmogil
nmogil merged commit b1930b4 into main Jul 11, 2026
2 checks passed
@nmogil
nmogil deleted the issue-7-harbor-foundation branch July 11, 2026 16:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adopt Harbor as the coding-eval execution foundation

1 participant