Skip to content

feat(evaluators): send authenticated execution context to runners api - #278

Merged
namrataghadi-galileo merged 15 commits into
mainfrom
feature/SAO-17621-send-authenticated-execution-context-to-runners-api
Oct 2, 2026
Merged

namrataghadi-galileo merged 15 commits into
mainfrom
feature/SAO-17621-send-authenticated-execution-context-to-runners-api

Conversation

@namrataghadi-galileo

@namrataghadi-galileo namrataghadi-galileo commented Oct 1, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Add Galileo execution_context to the existing POST /api/v1/scorers/invoke request.
  • Map the authenticated Agent Control context to Galileo fields: namespace_key → organization_id, caller_id → user_id, trusted extension project_id → project_id, and supported target ID → run_id.
  • Emit optional context values as null; preserve legacy requests when no runtime extensions are present.

Scope

  • User-facing/API changes: Galileo scorer invocation includes the additive execution_context object.
  • Internal changes: Context translation stays inside the Galileo evaluator package. run_id is set only for log_stream and agent_stream targets.
  • Out of scope: Generic Agent Control models/auth, scorer-grant flows, record serialization/factory, and record normalization.

Risk and Rollout

  • Risk level: low
  • Rollback plan: Revert the Galileo package changes; callers without runtime context continue using the legacy request shape.

Testing

  • Added or updated automated tests
  • Ran Galileo package tests: 172 passed
  • Ran Galileo Ruff: all checks passed
  • Ran make check (package Makefile targets could not resolve hatchling because the configured package index returned HTTP 401; equivalent package-local test and Ruff commands passed from the existing virtualenv)
  • Manually verified behavior

Checklist

  • Linked issue/spec (if applicable)
  • Updated docs/examples for user-facing changes
  • Included any required follow-up tasks

@namrataghadi-galileo
namrataghadi-galileo changed the base branch from main to feature/SAO-17620-pass-scorer-context-to-galileo-evaluators October 1, 2026 18:13
@codecov

codecov Bot commented Oct 1, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Base automatically changed from feature/SAO-17620-pass-scorer-context-to-galileo-evaluators to main October 1, 2026 18:55
@namrataghadi-galileo
namrataghadi-galileo merged commit 60814a8 into main Oct 2, 2026
6 checks passed
@namrataghadi-galileo
namrataghadi-galileo deleted the feature/SAO-17621-send-authenticated-execution-context-to-runners-api branch October 2, 2026 18:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants