Repository navigation
Commit 59b2ec5
authored
feat(evaluators): put runtime records behind a flag (#288)
## Summary
- Gate structured Galileo Luna scorer-invoke data behind
`GALILEO_FEATURE_FLAG_SCORER_INVOKE_RUNTIME`.
- Only the exact value `enabled` sends the serialized Galileo record and
runtime execution context; an unset or other value preserves the legacy
request and its inputs.
## Scope
- User-facing/API changes: None.
- Internal changes: Read the feature flag within the Galileo evaluator
package and gate record generation and execution-context serialization
in its Luna client. Existing scorer identity, authentication, timeout,
and response handling remain intact.
- Out of scope: Generic Agent Control code, Orbit calls, and
authentication-flow changes.
## Risk and Rollout
- Risk level: low.
- Rollback plan: Unset the flag or set it to a value other than
`enabled` to restore legacy request behavior.
## Testing
- [x] Added or updated automated tests for missing, disabled, non-exact,
and enabled flag behavior.
- [x] Ran Galileo package tests (`make test`): 205 passed.
- [x] Ran Galileo package lint (`make lint`) and typecheck (`make
typecheck`).
- [ ] Ran `make check` (individual package test, lint, and typecheck
targets were run instead).
- [ ] Manually verified behavior.
## Checklist
- [ ] Linked issue/spec (if applicable).
- [ ] Updated docs/examples for user-facing changes.
- [ ] Included any required follow-up tasks.1 parent bc1e15e commit 59b2ec5
3 files changed
Lines changed: 72 additions & 3 deletions
File tree
- evaluators/contrib/galileo
- src/agent_control_evaluator_galileo/luna
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | | - | |
| 22 | + | |
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| |||
367 | 367 | | |
368 | 368 | | |
369 | 369 | | |
| 370 | + | |
| 371 | + | |
370 | 372 | | |
371 | 373 | | |
372 | 374 | | |
| |||
414 | 416 | | |
415 | 417 | | |
416 | 418 | | |
| 419 | + | |
417 | 420 | | |
418 | 421 | | |
419 | 422 | | |
| |||
559 | 562 | | |
560 | 563 | | |
561 | 564 | | |
562 | | - | |
| 565 | + | |
563 | 566 | | |
564 | 567 | | |
565 | 568 | | |
| |||
573 | 576 | | |
574 | 577 | | |
575 | 578 | | |
576 | | - | |
| 579 | + | |
577 | 580 | | |
578 | 581 | | |
579 | 582 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| 5 | + | |
5 | 6 | | |
6 | 7 | | |
7 | 8 | | |
| |||
12 | 13 | | |
13 | 14 | | |
14 | 15 | | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
15 | 22 | | |
16 | 23 | | |
17 | 24 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
20 | 25 | | |
21 | 26 | | |
22 | 27 | | |
| |||
885 | 890 | | |
886 | 891 | | |
887 | 892 | | |
| 893 | + | |
| 894 | + | |
| 895 | + | |
| 896 | + | |
| 897 | + | |
| 898 | + | |
| 899 | + | |
| 900 | + | |
| 901 | + | |
| 902 | + | |
| 903 | + | |
| 904 | + | |
| 905 | + | |
| 906 | + | |
| 907 | + | |
| 908 | + | |
| 909 | + | |
| 910 | + | |
| 911 | + | |
| 912 | + | |
| 913 | + | |
| 914 | + | |
| 915 | + | |
| 916 | + | |
| 917 | + | |
| 918 | + | |
| 919 | + | |
| 920 | + | |
| 921 | + | |
| 922 | + | |
| 923 | + | |
| 924 | + | |
| 925 | + | |
| 926 | + | |
| 927 | + | |
| 928 | + | |
| 929 | + | |
| 930 | + | |
| 931 | + | |
| 932 | + | |
| 933 | + | |
| 934 | + | |
| 935 | + | |
| 936 | + | |
| 937 | + | |
| 938 | + | |
| 939 | + | |
| 940 | + | |
| 941 | + | |
| 942 | + | |
| 943 | + | |
| 944 | + | |
| 945 | + | |
| 946 | + | |
888 | 947 | | |
889 | 948 | | |
890 | 949 | | |
| |||
0 commit comments