Skip to content

[code-genetics] feat: determine the origin of files from combined origin matches - #2282

Merged
tdruez merged 12 commits into
mainfrom
code-genetics-1929-origin-determination
Nov 2, 2026
Merged

tdruez merged 12 commits into
mainfrom
code-genetics-1929-origin-determination

Conversation

@tdruez

@tdruez tdruez commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Issues

Determine the origin of each matched file and directory by combining the origin matches of MatchCode.io and SCANOSS. Confirmed origins become packages, so they appear in the existing outputs.

How it works

The find_origins pipeline ends with a new determine_origins step:

  1. Group the matches of each resource by package, including the equivalent PURLs reported by the tools (pkg:github/benjaminp/six and pkg:pypi/six).
  2. A matched directory covers its files, and the deepest matched directory wins.
  3. Apply the rules below to set an OriginDetermination per resource: auto-confirmed or needs-review.
  4. Assign the resources of confirmed origins to their package, created with its license and URLs when missing.

Re-running the pipeline replaces the automatic determinations and keeps the decisions made by users.

Rules

Rule When Status
conflicting-candidates Several different packages needs-review
conflicting-versions Several versions of the same package needs-review
no-exact-match Only partial matches needs-review
single-tool Exact match reported by one tool only needs-review
confirmed-by-two-tools One package, at least one exact match, reported by both tools auto-confirmed

Changes

  • Add the OriginDetermination model: one per resource, with the origin PURL, status and rule.
  • Add the determine_origins step to the find_origins pipeline.
  • Add the origin pipe module with the determination rules.
  • Assign the resources of confirmed origins to their package.
  • Fix the list rendering of the FindOrigins docstring in the documentation.

Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
@tdruez tdruez changed the title [code-genetics] feat: add the OriginDetermination model [code-genetics] feat: determine the origin of files from combined origin matches Oct 29, 2026
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
Signed-off-by: tdruez <tdruez@aboutcode.org>
@tdruez
tdruez merged commit 237ea33 into main Nov 2, 2026
12 checks passed
@tdruez
tdruez deleted the code-genetics-1929-origin-determination branch November 2, 2026 12:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

code-genetics: Design and implement heuristics to combine origin matches

1 participant