Figure generator seeds random but includes "Ours" in default methods list
Severity: Low
File: backend/app/services/figure_generator.py:41
The generate_comparison_bars function accepts a seed parameter for reproducibility, but when methods is not provided, it defaults to a list with "Ours" as the first entry. The random draws for "Ours" will always appear first in the legend and may receive favorable random values due to seed interaction.
rng = random.Random(seed)
if not methods:
methods = ["Ours", "Baseline-A", "Baseline-B", "Baseline-C", "Prior-SOTA"]
if not datasets:
datasets = ["Dataset-1", "Dataset-2", "Dataset-3"]
Why it matters
Generated comparison charts may inadvertently bias results toward "Ours" due to deterministic seeding and list ordering, undermining scientific reproducibility claims.
Figure generator seeds random but includes "Ours" in default methods list
Severity: Low
File:
backend/app/services/figure_generator.py:41The
generate_comparison_barsfunction accepts aseedparameter for reproducibility, but whenmethodsis not provided, it defaults to a list with "Ours" as the first entry. The random draws for "Ours" will always appear first in the legend and may receive favorable random values due to seed interaction.Why it matters
Generated comparison charts may inadvertently bias results toward "Ours" due to deterministic seeding and list ordering, undermining scientific reproducibility claims.