Repository navigation
Commit 65b8e4d
committed
Take evidence recording off the editor reply path
Two in three spoken replies still waited on a tool round, and nearly
every one was the interviewer calling record_framework_evidence for
Repeat, Example or Algorithm: steps the prompt told it to leave alone
and the phase judge records anyway. Each call holds the reply back by a
second model pass. Neither the prompt nor leaving those steps out of
the tool's schema stopped the calls, so at a typed editor the tool is
no longer declared. The prompt says the platform records each step, and
that the editor is not to be read to learn whether one was: without the
tool's replies the model did that instead, a tool round all the same.
Test events there no longer ask for an evidence call either.
The phase judge now covers what only the tool recorded there. It
records Test from a hand trace while nothing can run the written code,
judged with the code in view and only from speech, and the STAR steps,
quoted only from inside the behavioral round and not from a story the
interviewer told first; it reads the round as new once it holds
something, and again when its start moves back to the interviewer turn
in flight. Repeat, Example and Algorithm stay open after Coding while a
step about the code is, and a coding-round step may be quoted from a
comment the candidate typed, as one whose speech was not recognized is
asked to, recorded as an editor snapshot. It can report a declined
probe, and the platform writes the end-of-session skips for a started
round that the wrap-up used to ask for, except where the probe was
declined. The coding round's routine judgments leave 8 of the 48 for a
behavioral round still to come; the last judgment and a round
transition may spend them. A whiteboard keeps the tool, its wording and
the judge as they were, since the judge is not shown the board.1 parent cfe38ad commit 65b8e4d
14 files changed
Lines changed: 967 additions & 314 deletions
File tree
- docs
- src
- agent
- livekit
- tests
- agent
- golden
- unit
- livekit
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
195 | 195 | | |
196 | 196 | | |
197 | 197 | | |
198 | | - | |
199 | | - | |
200 | | - | |
201 | | - | |
202 | | - | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
203 | 207 | | |
204 | 208 | | |
205 | 209 | | |
206 | 210 | | |
207 | 211 | | |
208 | 212 | | |
209 | 213 | | |
210 | | - | |
211 | | - | |
212 | | - | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
213 | 218 | | |
214 | 219 | | |
215 | 220 | | |
| |||
408 | 413 | | |
409 | 414 | | |
410 | 415 | | |
411 | | - | |
412 | | - | |
| 416 | + | |
| 417 | + | |
413 | 418 | | |
414 | 419 | | |
415 | 420 | | |
| |||
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
622 | 622 | | |
623 | 623 | | |
624 | 624 | | |
625 | | - | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
626 | 630 | | |
627 | 631 | | |
628 | 632 | | |
| |||
819 | 823 | | |
820 | 824 | | |
821 | 825 | | |
| 826 | + | |
| 827 | + | |
| 828 | + | |
| 829 | + | |
| 830 | + | |
| 831 | + | |
| 832 | + | |
822 | 833 | | |
823 | 834 | | |
824 | 835 | | |
| |||
830 | 841 | | |
831 | 842 | | |
832 | 843 | | |
833 | | - | |
| 844 | + | |
834 | 845 | | |
835 | 846 | | |
836 | 847 | | |
| |||
878 | 889 | | |
879 | 890 | | |
880 | 891 | | |
881 | | - | |
882 | | - | |
883 | | - | |
884 | | - | |
| 892 | + | |
| 893 | + | |
| 894 | + | |
| 895 | + | |
| 896 | + | |
| 897 | + | |
| 898 | + | |
| 899 | + | |
| 900 | + | |
885 | 901 | | |
886 | 902 | | |
887 | 903 | | |
| |||
0 commit comments