You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit c2bf445
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: src/content/docs/guides/investigate-test-history-with-ai.mdx
+1-20Lines changed: 1 addition & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -38,26 +38,7 @@ The conversations below are representative examples. Your results will use your
38
38
</AssistantMessage>
39
39
</Conversation>
40
40
41
-
<Conversationtitle="Did this branch make the suite less reliable?">
42
-
<UserMessage>
43
-
Compare this branch with main over the last two weeks. Did it make our tests less reliable?
44
-
</UserMessage>
45
-
46
-
<ToolCallname="query_analytics"summary="test pass rate grouped by branch, last 2 weeks" />
47
-
<ToolCallname="query_analytics"summary="failure count grouped by test on the current branch" />
48
-
<ToolCallname="query_samples"summary="sample failures unique to the current branch" />
49
-
50
-
<AssistantMessage>
51
-
The current branch has a 94.8% test pass rate, compared with 98.9% on `main`. Most of the difference comes from two tests:
52
-
53
-
-`account.spec.ts › saves notification preferences` failed 7 times on this branch and did not fail on `main`.
54
-
-`navigation.spec.ts › opens the profile menu` failed 3 times here and once on `main`.
55
-
56
-
The notification test failures all start after commit `8f32a1c` and report that the save request returned 409. That points to a regression on this branch rather than general suite flakiness. The profile-menu failures look unrelated: their errors and retry behavior match the existing failures on `main`.
57
-
</AssistantMessage>
58
-
</Conversation>
59
-
60
-
<Conversationtitle="Which tests are slowing down feedback?">
41
+
<Conversationtitle="Which tests are slowest?">
61
42
<UserMessage>
62
43
Which individual tests have the biggest effect on our test runtime? Check whether any have become slower recently.
0 commit comments