Skip to content

[OPIK-7421] test: add Ollie explain E2E release-gate test - #7564

Merged
natagh23 merged 4 commits into
mainfrom
nata/OPIK-7421/ollie-explain
Jul 22, 2026
Merged

[OPIK-7421] test: add Ollie explain E2E release-gate test#7564
natagh23 merged 4 commits into
mainfrom
nata/OPIK-7421/ollie-explain

Conversation

@natagh23

Copy link
Copy Markdown
Contributor

Details

Adds an E2E release-gate test for the "Explain" (Ollie) feature on the Traces table: for each seeded trace it opens the Errors, Estimated cost, and Duration cell explanations and asserts the returned text is on-topic, then verifies "Continue conversation" hands the same explanation off to the Ollie sidebar. Also seeds a dedicated fixture of traces with varied cost/duration/error data to exercise each explanation path, and extends the SDK driver service with the trace fields needed to seed them.

Change checklist

  • User facing
  • Documentation update

Issues

  • Resolves OPIK-7421

AI-WATERMARK

AI-WATERMARK: yes

  • Tools: Claude Code
  • Model(s): Claude Sonnet 5
  • Scope: full implementation
  • Human verification: code review + manual testing

Testing

Ran npx tsc --noEmit in tests_end_to_end/e2e (clean) and python3 -m py_compile on the modified opik-sdk-driver route/schema files (clean). New spec added under @t3-nightly/@ollie tags; not run against a live cloud environment in this session since Ollie is cloud/client-only.

Documentation

N/A

@github-actions github-actions Bot added python Pull requests that update Python code tests Including test files, or tests related like configuration. typescript *.ts *.tsx 🟠 size/L labels Jul 22, 2026
@github-actions

github-actions Bot commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

⏱️ pre-commit per-hook timing

Hook Description Result Duration
🐳 hadolint — dockerfiles Lint Dockerfiles 3.11s
🛡️ fix end of files — guardrails Ensure files end in a newline 0.03s
🛡️ trim trailing whitespace — guardrails Strip trailing whitespace 0.03s
Total (3 ran) 3.17s
⏭️ 38 skipped (no matching files changed)
Hook Description Result
🐍 trim trailing whitespace — python sdk Strip trailing whitespace ⏭️
🐍 fix end of files — python sdk Ensure files end in a newline ⏭️
🐍 ruff — python sdk Lint + autofix Python (ruff) ⏭️
🐍 ruff-format — python sdk Format Python code (ruff) ⏭️
🐍 mypy — python sdk Static type check ⏭️
🤖 trim trailing whitespace — optimizer Strip trailing whitespace ⏭️
🤖 fix end of files — optimizer Ensure files end in a newline ⏭️
🤖 check yaml — optimizer Validate YAML syntax ⏭️
🤖 check json — optimizer Validate JSON syntax ⏭️
🤖 check toml — optimizer Validate TOML syntax ⏭️
🤖 check for added large files — optimizer Block large files (>1MB) ⏭️
🔐 detect private key — optimizer Block committed private keys ⏭️
🤖 check for merge conflicts — optimizer Block merge-conflict markers ⏭️
🤖 check for case conflicts — optimizer Block case-only name clashes ⏭️
🤖 pyupgrade — optimizer Modernize Python syntax ⏭️
🤖 ruff — optimizer Lint + autofix Python (ruff) ⏭️
🤖 ruff-format — optimizer Format Python code (ruff) ⏭️
🤖 mypy — optimizer Static type check ⏭️
📓 nbstripout — optimizer notebooks Strip notebook output ⏭️
📝 markdownlint — optimizer Lint Markdown ⏭️
🔤 codespell — optimizer Fix common misspellings ⏭️
📊 radon cc — optimizer Cyclomatic-complexity gate ⏭️
📊 radon raw — optimizer Raw size metrics gate ⏭️
📊 xenon — optimizer Fail on complexity thresholds ⏭️
📊 lizard — optimizer Cyclomatic-complexity gate ⏭️
🧹 vulture — optimizer Find dead code ⏭️
🛡️ ruff — guardrails Lint + autofix Python (ruff) ⏭️
🛡️ ruff-format — guardrails Format Python code (ruff) ⏭️
🛡️ mypy — guardrails Static type check ⏭️
⚓ helm-docs Regenerate Helm chart README ⏭️
block non-public FE plugins Block non-public FE plugins ⏭️
☕ spotless — java backend Format Java code ⏭️
🧪 pre-commit wrapper smoke tests Self-test the wrapper scripts ⏭️
🌐 eslint — frontend Lint + autofix JS/TS ⏭️
🌐 typecheck — frontend Whole-project tsc type check ⏭️
📘 eslint — typescript sdk Lint + autofix JS/TS ⏭️
📘 typecheck — typescript sdk Whole-project tsc type check ⏭️
⚙️ actionlint — github workflows Lint GitHub Actions workflows ⏭️

Comment thread tests_end_to_end/e2e/pom/ollie.page.ts Outdated
Comment thread tests_end_to_end/e2e/pom/ollie.page.ts
Comment thread tests_end_to_end/e2e/pom/ollie.page.ts Outdated
@natagh23
natagh23 marked this pull request as ready for review July 22, 2026 12:14
@natagh23
natagh23 requested review from a team as code owners July 22, 2026 12:14
@natagh23
natagh23 merged commit 79aaa97 into main Jul 22, 2026
18 checks passed
@natagh23
natagh23 deleted the nata/OPIK-7421/ollie-explain branch July 22, 2026 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python Pull requests that update Python code 🟠 size/L tests Including test files, or tests related like configuration. typescript *.ts *.tsx

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants