Closed Bug 2020224 Opened 7 months ago Closed 6 months ago

Add coverage and diff-coverage to NSS CI

Categories

(NSS :: Tools, enhancement, P1)

enhancement

Tracking

(nss 3.122)

RESOLVED FIXED
Tracking Status
nss --- 3.122

People

(Reporter: djackson, Assigned: djackson)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

No description provided.

This commit adds two new CI jobs: FuzzCov and TestCov.

FuzzCov runs all of NSS's fuzzers with the public OSS-Fuzz corpus
and records the coverage information. It produces a summary of the coverage information (HTML, lcov) as well as a report
on which lines in the commit were not covered by fuzzing.

TestCov runs all of NSS's tests via all.sh and works similarly to FuzzCov.
However, it enforces that at least 90% of the changed lines in the commit were covered by the test suite.
This is helps ensure that newly added or changed code in NSS is effectively tested.

The two jobs are also integrated into mach and can be run locally - including for specific fuzzers or test suites.

Blocks: nss-ci

Pushed by djackson@mozilla.com:
https://hg.mozilla.org/projects/nss/rev/570afd9c6c30
Add more useful coverage reports to CI and fail if new commit isn't tested. r=nss-reviewers,jschanck

Status: NEW → RESOLVED
Closed: 6 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: