Prepare Mogil Bench v0.1.0 public-alpha release

[nmogil]

Outcome

The merged repository is ready for a deliberate v0.1.0 public-alpha GitHub release, with installable artifacts, clear OSS policies, accurate metadata, and a reproducible release checklist.

Completion

Released as a GitHub public-alpha pre-release on 2026-07-15:
https://github.com/mogilventures/mogil-bench/releases/tag/v0.1.0

Annotated tag v0.1.0 targets reviewed merge commit 505ad003f4a0e8bd8375ec475dc71320db08e196. The release includes the wheel, sdist, and SHA256SUMS. PyPI remains deferred.

Parent: #9
Implemented by #21 and finalized by #22.

In-repo requirements

• Add accurate project URLs, authors/maintainers, Python classifiers, and typed-package metadata to pyproject.toml without changing runtime pins.
• Add concise public-alpha positioning, status/CI badges, supported boundaries, and the complete provider-parity → BlindBench comparison workflow to README.
• Add minimal CONTRIBUTING.md, SECURITY.md, and CHANGELOG.md.
• Add a release runbook/checklist covering clean main, tests, Ruff, mypy, Docker smoke, wheel/sdist build, clean wheel install smoke, secret scan, tag, GitHub release, and immutable runtime reference verification.
• Extend CI to build the distribution and smoke-install/run the wheel in a clean environment.
• Preserve Python 3.12, Harbor 0.18.0, Daytona SDK 0.196.0, and container Pi 0.80.6 pins.

Repository settings / post-merge checklist

• Change the GitHub description so it no longer says “Private.”
• Add relevant repository topics.
• Protect main with PRs, non-fast-forward/deletion protection, and conversation resolution while keeping the current solo/agent workflow viable.
• Create the v0.1.0 GitHub release only after the implementation PR is reviewed and merged.
• Defer PyPI publication until package-data/template policy and trusted publishing are explicitly approved.

Acceptance criteria

• Full CI and local verification pass.
• Wheel and sdist build successfully.
• A clean environment can install the built wheel, run mogil-bench --help, and complete the credential-free sample workflow from a repository checkout.
• Release docs make public-alpha limitations and pinned compatibility explicit.
• No secrets or customer data exist in current files or history.

Non-goals

• Publishing to PyPI.
• Broadening supported Python/provider/sandbox versions.
• Implementing BlindBench UI backlog items.

[nmogil]

Implemented in #21. Core implementation used Herdr-managed Pi on openai-codex/gpt-5.6-sol; independent no-edit review used a separate Herdr-managed Pi lane on anthropic/claude-opus-4-5 and found no P0/P1 issues. Local gates: 140 passed / 1 manually gated Daytona test deselected, Ruff clean, strict mypy clean, wheel+sdist built, real 18-run parity export produced 9 BlindBench-valid comparisons. GitHub test, docker-smoke, and distribution checks are green. Pending Noah review and merge.

[nmogil]

Tracking clarification: #21 completes the in-repository implementation and intentionally advances rather than closes this issue. Keep #20 open after merge until the post-merge repository description/topics, main protection, changelog date, annotated v0.1.0 tag, and public-alpha GitHub release are completed and verified. PyPI remains deferred.

[nmogil]

Post-merge activation progress after #21:\n\n- Repository description corrected and topics added: agent-evaluation, benchmark, blind-evaluation, coding-agents, daytona, harbor, python.\n- Active default-branch ruleset created: ID 18982054; requires PRs, blocks default-branch deletion and non-fast-forward updates, requires conversation resolution, and intentionally requires 0 approvals for the current solo/agent identity workflow. Rollback: gh api -X DELETE repos/mogilventures/mogil-bench/rulesets/18982054.\n- Final merged-main release gates passed: 140 tests + explicit Docker smoke, Ruff, mypy, build, clean wheel install with PYTHONPATH unset, sample validation, zero credential-pattern findings, anonymous immutable runtime fetch, and runtime contract inspection.\n- Release-date finalization PR: #22. All three CI checks are green.\n\nKeep this issue open until #22 merges and the annotated tag/GitHub pre-release/assets are created and verified. PyPI remains deferred.

[nmogil]

Release verification complete. Annotated v0.1.0 targets 505ad003f4a0e8bd8375ec475dc71320db08e196; GitHub release is a published pre-release/public alpha with wheel, sdist, and SHA256SUMS. Fresh public downloads passed checksum verification. Runtime digest remains sha256:7728671c38220e066d23f63fd2544cc0722874ec40e1c86c883c8cc4d6c35dfe and passed anonymous-fetch plus runtime-contract inspection. PyPI remains deferred.