Skip to content

Commit c2bf445

Browse files
committed
Fixup ai example conversations in history investigation
1 parent 12aa42e commit c2bf445

1 file changed

Lines changed: 1 addition & 20 deletions

File tree

‎src/content/docs/guides/investigate-test-history-with-ai.mdx‎

Lines changed: 1 addition & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -38,26 +38,7 @@ The conversations below are representative examples. Your results will use your
3838
</AssistantMessage>
3939
</Conversation>
4040

41-
<Conversation title="Did this branch make the suite less reliable?">
42-
<UserMessage>
43-
Compare this branch with main over the last two weeks. Did it make our tests less reliable?
44-
</UserMessage>
45-
46-
<ToolCall name="query_analytics" summary="test pass rate grouped by branch, last 2 weeks" />
47-
<ToolCall name="query_analytics" summary="failure count grouped by test on the current branch" />
48-
<ToolCall name="query_samples" summary="sample failures unique to the current branch" />
49-
50-
<AssistantMessage>
51-
The current branch has a 94.8% test pass rate, compared with 98.9% on `main`. Most of the difference comes from two tests:
52-
53-
- `account.spec.ts › saves notification preferences` failed 7 times on this branch and did not fail on `main`.
54-
- `navigation.spec.ts › opens the profile menu` failed 3 times here and once on `main`.
55-
56-
The notification test failures all start after commit `8f32a1c` and report that the save request returned 409. That points to a regression on this branch rather than general suite flakiness. The profile-menu failures look unrelated: their errors and retry behavior match the existing failures on `main`.
57-
</AssistantMessage>
58-
</Conversation>
59-
60-
<Conversation title="Which tests are slowing down feedback?">
41+
<Conversation title="Which tests are slowest?">
6142
<UserMessage>
6243
Which individual tests have the biggest effect on our test runtime? Check whether any have become slower recently.
6344
</UserMessage>

0 commit comments

Comments
 (0)