Skip to content

docs(sdk): inventory change-detector tests - #5974

Closed
Mason Daugherty (mdrxy) wants to merge 2 commits into
mainfrom
mdrxy/docs/change-detector-test-audit
Closed

docs(sdk): inventory change-detector tests#5974
Mason Daugherty (mdrxy) wants to merge 2 commits into
mainfrom
mdrxy/docs/change-detector-test-audit

Conversation

@mdrxy

@mdrxy Mason Daugherty (mdrxy) commented Aug 28, 2026

Copy link
Copy Markdown
Member

Audits all 2,463 Python test functions under libs/deepagents/tests against the strict change-detector definition from the Google Testing Blog.

The new tracking file records 49 findings with exact pytest node IDs, concrete reasons, and rewrite-or-delete recommendations. It also documents the audit baseline, scope, exclusions, and maintenance process so the inventory can be updated deliberately.

Made by Open SWE

Co-authored-by: open-swe[bot] <open-swe@users.noreply.github.com>
@github-actions github-actions Bot added deepagents Related to the `deepagents` SDK / agent harness documentation Improvements or additions to documentation internal User is a member of the `langchain-ai` GitHub organization size: S 50-199 LOC labels Aug 28, 2026
@mdrxy
Mason Daugherty (mdrxy) marked this pull request as ready for review August 28, 2026 22:29

@open-swe open-swe Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Open SWE Review found 1 potential issue.

Open in WebView Open SWE trace


The audit is intentionally narrower than a general test-quality review. A test is
not listed merely because it uses mocks, accesses a private helper, is redundant,
is brittle, or has weak assertions. Snapshot tests for model-facing output,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Audit baseline undercounts test functions

At the stated baseline, parsing the 79 Python files under libs/deepagents/tests yields 2,464 test* function definitions, not 2,463. This makes the claimed complete-audit baseline internally inaccurate and causes future re-audits to compare against the wrong total. Please update the count to 2,464 (and the matching PR summary).

(Refers to line 19)


Your feedback helps Open SWE learn. React with 👍 or 👎 to tell us if this review comment was useful.

Suggested change
is brittle, or has weak assertions. Snapshot tests for model-facing output,
- Test functions reviewed: 2,464

@open-swe

open-swe Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Superseded by #5975, which removes the audited change-detector tests.

@open-swe open-swe Bot closed this Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepagents Related to the `deepagents` SDK / agent harness documentation Improvements or additions to documentation internal User is a member of the `langchain-ai` GitHub organization size: S 50-199 LOC

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant