Skip to content

Build/Test Tools: Preserve grouped tests on older PHPUnit versions - #13641

Closed
lancewillett wants to merge 1 commit into
WordPress:trunkfrom
lancewillett:fix/phpunit-empty-suite-compat
Closed

lancewillett wants to merge 1 commit into
WordPress:trunkfrom
lancewillett:fix/phpunit-empty-suite-compat

Conversation

@lancewillett

@lancewillett lancewillett commented Sep 21, 2026 •

Copy link
Copy Markdown
Member

Trac ticket: https://core.trac.wordpress.org/ticket/65889

Follow-up to r63778 / #13523, found while preparing the release-branch workflow changes for Trac #66069.

Grouped PHPUnit runs on PHP 7.2 use PHPUnit 8.5, which rejects the newly added --fail-on-empty-test-suite option before running any tests. Older release branches call this shared workflow from trunk, so they are affected even though trunk's PHP versions support the option.

Keep --group on all grouped runs, and add the empty-suite flag only on PHP 7.3 and newer, where the current dependencies resolve to PHPUnit 9.6. This follows the PHP-version conditions already used by the v1 and v2 reusable workflows. The Core assets job retains its empty-suite protection; older PHPUnit versions keep their previous empty-suite behavior.

Validation

  • Reproduced unrecognized option --fail-on-empty-test-suite with PHPUnit 8.5.54 on PHP 7.2.
  • With the revised arguments, a selected group passes on PHP 7.2 / PHPUnit 8.5, PHP 7.3 / PHPUnit 9.6, and PHP 8.3 / PHPUnit 9.6.
  • A missing group still exits 1 on PHP 7.3 and PHP 8.3. PHP 7.2 retains its prior exit-0 behavior for an empty suite.
  • Actionlint and git diff --check passed.

Use of AI tools

AI assistance: Yes.
Tool: Codex.
Model: GPT-6.
Used for: Diagnosis, implementation, and container-based validation. Reviewed by me.

@github-actions

Copy link
Copy Markdown

The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the props-bot label.

Core Committers: Use this line as a base for the props when committing in SVN:

Props lancewillett.

To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook.

@lancewillett
lancewillett requested a review from a team September 21, 2026 18:36
@lancewillett

Copy link
Copy Markdown
Member Author

This fix needs to land on trunk before fresh runs of #13639 and #13640 can use it to verify CI 100%.

wporg-sync pushed a commit that referenced this pull request Sep 21, 2026
Only pass --fail-on-empty-test-suite on PHP 7.3 and newer, where the supported PHPUnit versions recognize it. Preserve group selection on older versions so release branches using the shared workflow can run their tests.

Keep empty-suite protection for the Core assets job and other grouped runs on supported PHPUnit versions.

Developed in: #13641

Props lancewillett, adrianmoldovanwp.
See #65889.


git-svn-id: https://develop.svn.wordpress.org/trunk@63786 602fd350-edb4-49c9-b593-d223f7449a82
wporg-sync pushed a commit to WordPress/WordPress that referenced this pull request Sep 21, 2026
Only pass --fail-on-empty-test-suite on PHP 7.3 and newer, where the supported PHPUnit versions recognize it. Preserve group selection on older versions so release branches using the shared workflow can run their tests.

Keep empty-suite protection for the Core assets job and other grouped runs on supported PHPUnit versions.

Developed in: WordPress/wordpress-develop#13641

Props lancewillett, adrianmoldovanwp.
See #65889.

Built from https://develop.svn.wordpress.org/trunk@63786


git-svn-id: http://core.svn.wordpress.org/trunk@62958 1a063a9b-81f0-0310-95a4-ce76da25c4cd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants