-
-
Notifications
You must be signed in to change notification settings - Fork 537
Description
We are encountering a reporting issue in Serenity BDD version 4.2.34 when using JUnit5 with parallel execution and tag filtering.
Setup:
Serenity BDD version: 4.2.34
Test framework: JUnit5
Execution mode: Parallel
Command used: mvn clean verify -Dcucumber.filter.tags=@test
Total test cases executed: 197
Actual results:
Passed + Failed + Broken = 197
Skipped = 3 (shown in HTML report)
However, no test cases are actually skipped, and .json reports confirm this.
Observations:
The skipped count appears in the HTML report summary, but when clicking into the skipped section, it shows 0 test cases.
This affects the overall percentage calculation, misleading stakeholders reviewing the report.
The skipped entries seem to be steps within failed scenarios, not entire test cases.
What’s Verified:
.json files in target/site/serenity do not contain any skipped test cases.
All scenarios are either passed, failed, or broken.
No use of Assume.assumeTrue() or conditional skipping in hooks.
Request:
Please investigate whether this is a known issue with the HTML report rendering logic in Serenity BDD 4.2.34, especially under parallel execution with JUnit5. If possible, provide a workaround or confirm if a fix is planned in future releases.
