Switch coverage reports format from OpenCover to Cobertura #1795
+140
−97
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Updated build pipeline to generate Cobertura coverage reports instead of OpenCover. Adjusted test commands and coverage publishing steps to use the new format. No other pipeline logic was changed.
Collaborator
Author
|
The CI run also generates cobertura coverage files for integration test deterministic build feature. This shall not be used for the report. 
|
ignore assembly coverletsample.integration.determisticbuild
Bertk
changed the title
There was a problem hiding this comment.
Pull request overview
This PR switches the coverage report format from OpenCover to Cobertura in the Azure Pipelines build configuration. The change addresses inconsistent coverage results observed between CI runs on PR branches versus the master branch.
Key changes:
- Updated all test commands to use
/p:CoverletOutputFormat=coberturainstead ofopencover - Updated coverage report file pattern from
*.opencover.xmlto*.cobertura.xml - Added
-coverletsample.integration.determisticbuildto assembly exclusion filters
Update test scripts to use Cobertura format for coverage reports and improve result file naming and logging. Add report.sh for generating coverage reports with ReportGenerator. Enhance build.sh cleanup to remove all *.binlog files across the workspace.
…e namespace Refactored build.sh and test.sh to simplify build/test commands, removing most /p:ContinuousIntegrationBuild=true flags and explicitly targeting net8.0 for test runs. Updated TestUtils.cs to use Path.Combine for netstandard2.0 compatibility. Changed coverlet.tests.utils.csproj to target both netstandard2.0 and the minimum .NET version, increasing cross-platform support.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request updates the project's test coverage reporting format from OpenCover to Cobertura and makes several related adjustments to the build and reporting scripts. It also removes a legacy test script and expands the build and packaging steps for better cross-platform compatibility and package creation.
Key changes include:
Test Coverage Format and Reporting:
eng/build.ymlfrom OpenCover to Cobertura, and updated the coverage report publishing step and assembly filters accordingly. [1] [2]scripts/report.shscript to generate coverage reports using the Cobertura format and updated filters, replacing the previous OpenCover-based approach.Build and Packaging Improvements:
scripts/build.sh, renamed fromeng/build.sh) to:ContinuousIntegrationBuild=trueproperty from most build and pack commands.coverlet.core.coverage.testson Linux due to compatibility issues..binlogfiles across the repository, not just in one directory.Script and Test Cleanup:
eng/test.shscript, consolidating test logic into the build process.Updated build pipeline to generate Cobertura coverage reports instead of OpenCover. Adjusted test commands and coverage publishing steps to use the new format. No other pipeline logic was changed.Assumption: OpenCover generates different results for runs on CI (PR) and master branch.
Overall code line coverage results with OpenCover:
local build -> 88%, lines:974
PR (branch) -> 88%, lines:974
master branch -> 81%, lines:974 (after merge)