Skip to content

Commit db89678

Browse files
committed
ci(evals): Pass the job's test total to run-evals
run-evals checks it against the tests it collects, so a job fails rather than run another test than create-runs numbered. Needs getsentry/sentry-for-ai-evals#97. Refs VDY-312
1 parent c3db7aa commit db89678

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

‎.github/workflows/ai-evals.yml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -245,6 +245,7 @@ jobs:
245245
with:
246246
marker: ${{ matrix.job.marker }}
247247
test-index: ${{ matrix.job.test-index }}
248+
test-total: ${{ matrix.job.test-total }}
248249
count: ${{ matrix.job.count }}
249250
harness: ${{ matrix.job.target.harness }}
250251
model: ${{ matrix.job.target.model }}

0 commit comments

Comments
 (0)