Skip to content

Complete Part 2: audit and ingest xRouteBench - #6

Merged
MaharshPatelX merged 1 commit into
mainfrom
codex/xroutebench-ingestion
Aug 21, 2026
Merged

Complete Part 2: audit and ingest xRouteBench#6
MaharshPatelX merged 1 commit into
mainfrom
codex/xroutebench-ingestion

Conversation

@MaharshPatelX

Copy link
Copy Markdown
Owner

Summary

  • pin ulab-ai/xRouteBench at immutable revision ea4b6e1b29d9a734f55f0a637baf326bad6aa681
  • add a 41-file integrity manifest and exact 17-config schema/missingness snapshot
  • add a checksum-, schema-, dtype-, and row-count-validating Parquet adapter
  • add a safe-by-default verified downloader and synthetic test fixture
  • publish the Part 2 audit and update data policy, repository docs, and project tracker

Audit findings

  • 17 configs and 41 Parquet files
  • 245,903 physical rows across all configs
  • 47,382,959 bytes (47.38 MB / 45.19 MiB)
  • all 41 local SHA-256 hashes and row counts match the pinned upstream source
  • source is public and ungated, but the pinned card has no declared dataset license and the repository has no LICENSE file
  • no upstream rows are committed; the tracked fixture is authored synthetic data
  • the dataset-card prose says 4,487 generic training queries, while the pinned file and Hub APIs contain 4,489; the manifest records the file-backed value

Validation

  • ruff format --check .
  • ruff check .
  • mypy src tests
  • pytest — 11 passed
  • python -m build
  • both manifest JSON files parsed successfully
  • the downloader verified the pinned 8,450-byte sample
  • the real 18-row candidate-model Parquet sample loaded identically with two batch sizes

Scope boundary

This PR completes Part 2 only. It does not implement canonical Part 3 tables, deduplication, leakage-safe splits, baselines, model training, or benchmark claims.

Audit and pin the upstream dataset, add integrity metadata and schema
snapshots, implement value-preserving Parquet ingestion, and document the
unresolved redistribution license.
@MaharshPatelX
MaharshPatelX marked this pull request as ready for review August 21, 2026 09:48
@MaharshPatelX
MaharshPatelX merged commit 31365bd into main Aug 21, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant