Skip to content

[NA] [FE] fix: deduplicate eval suite input columns in experiment items table - #6181

Merged
alexkuzmik merged 5 commits into
mainfrom
alexkuzmik/NA-fix-duplicated-eval-suite-columns
Apr 13, 2026
Merged

[NA] [FE] fix: deduplicate eval suite input columns in experiment items table#6181
alexkuzmik merged 5 commits into
mainfrom
alexkuzmik/NA-fix-duplicated-eval-suite-columns

Conversation

@alexkuzmik

@alexkuzmik alexkuzmik commented Apr 10, 2026

Copy link
Copy Markdown
Collaborator

Details

When viewing evaluation suite experiments, the "input" column appeared twice — once under "Evaluation suite" (from dataset item data) and again under "Evaluation task (last trial)" (from experiment item output). This happened because the SDK always produces {"input": ..., "output": ...} as the task result, so the "input" key in the output always overlaps with the dataset's "input" key.

This fix filters dynamicOutputColumns to exclude the second "input" column when displaying the experiment item for evaluation suites.

Change checklist

  • User facing
  • Documentation update

Issues

  • NA

AI-WATERMARK

AI-WATERMARK: yes

  • If yes:
    • Tools: Claude Code
    • Model(s): Claude Opus 4.6
    • Scope: Implementation and PR creation
    • Human verification: Visual verification via UI screenshots

Testing

  • TypeScript type check (npx tsc --noEmit) — passes
  • ESLint on changed file — no errors
  • Manually verified via UI that duplicated "input" column no longer appears under "Evaluation task (last trial)" section

Documentation

N/A

…ms table

Filter out output columns whose names already appear in dataset columns
to avoid showing duplicate data (e.g. "input") in both the "Evaluation suite"
and "Evaluation task (last trial)" table sections.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Keep dynamicOutputColumns intact in the shared hook so filters and
column visibility state are unaffected. Apply the dedup filter only
when building outputColumnsData for table rendering.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
alexkuzmik and others added 2 commits April 10, 2026 16:15
… filters, and column picker

Compute visibleOutputColumns once and use it for outputColumnsData,
filterColumns, and columnSections so deduped columns don't appear
as phantom entries in the filter panel or column picker.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
… only

Only hide the "input" output column in eval suite mode, where the
evaluation task echoes back the dataset input. Regular experiments
are completely unaffected.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@alexkuzmik
alexkuzmik marked this pull request as ready for review April 10, 2026 14:32
@alexkuzmik
alexkuzmik requested a review from a team as a code owner April 10, 2026 14:32
@alexkuzmik alexkuzmik added the test-environment Deploy Opik adhoc environment label Apr 10, 2026
@github-actions

Copy link
Copy Markdown
Contributor

🔄 Test environment deployment process has started

Phase 1: Deploying base version 1.11.3-4876 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch alexkuzmik/NA-fix-duplicated-eval-suite-columns
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@CometActions

Copy link
Copy Markdown
Collaborator

Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

The deployment has completed successfully and the version has been verified.

@CometActions

Copy link
Copy Markdown
Collaborator

🌙 Nightly cleanup: The test environment for this PR (pr-6181) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

@CometActions CometActions removed the test-environment Deploy Opik adhoc environment label Apr 11, 2026
@CometActions

Copy link
Copy Markdown
Collaborator

🌙 Nightly cleanup: The test environment for this PR (pr-6181) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

1 similar comment
@CometActions

Copy link
Copy Markdown
Collaborator

🌙 Nightly cleanup: The test environment for this PR (pr-6181) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

@alexkuzmik
alexkuzmik merged commit bf53fba into main Apr 13, 2026
10 checks passed
@alexkuzmik
alexkuzmik deleted the alexkuzmik/NA-fix-duplicated-eval-suite-columns branch April 13, 2026 07:55
jverre pushed a commit that referenced this pull request Jun 12, 2026
…ms table (#6181)

* [NA] [FE] fix: deduplicate eval suite input columns in experiment items table

Filter out output columns whose names already appear in dataset columns
to avoid showing duplicate data (e.g. "input") in both the "Evaluation suite"
and "Evaluation task (last trial)" table sections.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix(experiments): move column dedup to table display layer only

Keep dynamicOutputColumns intact in the shared hook so filters and
column visibility state are unaffected. Apply the dedup filter only
when building outputColumnsData for table rendering.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix(experiments): use consistent deduped output columns across table, filters, and column picker

Compute visibleOutputColumns once and use it for outputColumnsData,
filterColumns, and columnSections so deduped columns don't appear
as phantom entries in the filter panel or column picker.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix(experiments): scope eval suite output dedup to echoed "input" key only

Only hide the "input" output column in eval suite mode, where the
evaluation task echoes back the dataset input. Regular experiments
are completely unaffected.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix(experiments): fix prettier formatting and implicit any types

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants