Skip to content

Commit cc1fab4

Browse files
committed
fix: show error details in verbose benchmark output
When a sample errors during benchmark execution, the verbose output now shows the actual error message, making debugging easier: [✗] Sample niah-0000: {'correct': 0.0, 'f1': 0.0} Error: <actual error message here>
1 parent 84a05bd commit cc1fab4

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

‎benchmarks/runner.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -292,6 +292,8 @@ def _update_progress(
292292
if self.config.verbose:
293293
status = "✓" if sample_result.is_correct else "✗"
294294
print(f" [{status}] Sample {sample_result.sample_id}: {sample_result.metrics}")
295+
if sample_result.error:
296+
print(f" Error: {sample_result.error}")
295297

296298
def _run_sequential(
297299
self,

0 commit comments

Comments
 (0)