Closed Bug 1378239 Opened 7 years ago Closed 7 years ago

Change moz-info 'coverage' flag name to avoid ambiguity between ccov and jsdcov skipped tests.


(Testing :: Code Coverage, enhancement)

Not set


(firefox56 fixed)

Tracking Status
firefox56 --- fixed


(Reporter: sparky, Assigned: sparky)


(Blocks 1 open bug)



(1 file)

The flag currently in use to disable tests on linux64-ccov has the same name as the flag that is used by tests that need to be skipped on linux64-jsdcov. We should have two names so that the tests are not mistakenly disabled in both. 

For clarity, suppose that two tests within xpcshell are disabled. There is no way to distinguish which platform they should be disabled on and they will be disabled on both by default. Adding a second flag will help us make this distinction and remove the ambiguity.

A simple name to change it to would be 'ccoverage'. Then, the tests running on jsdcov could have the name 'jscoverage'.
Blocks: 1378241
:ahal, I wasn't sure who else could review this so if you think someone else should, feel free to change the reviewer. It's a small mozinfo change and here's a test run with these changes:
Comment on attachment 8883569 [details]
Bug 1378239 - Change mozinfo 'coverage' flag to 'ccov' to avoid ambiguity.

Thanks, looks good!

::: python/mozbuild/mozbuild/
(Diff revision 1)
>      d['require_signing'] = substs.get('MOZ_REQUIRE_SIGNING') == '1'
>      d['no_legacy_extensions'] = substs.get('MOZ_ALLOW_LEGACY_EXTENSIONS') == '0'
>      d['official'] = bool(substs.get('MOZILLA_OFFICIAL'))
>      d['updater'] = substs.get('MOZ_UPDATER') == '1'
>      d['artifact'] = substs.get('MOZ_ARTIFACT_BUILDS') == '1'
> -    d['coverage'] = substs.get('MOZ_CODE_COVERAGE') == '1'
> +    d['ccoverage'] = substs.get('MOZ_CODE_COVERAGE') == '1'

This might just be better as 'ccov'. I'll leave it up to you.
Attachment #8883569 - Flags: review?(ahalberstadt) → review+
Thanks for the review!

I thought about this at the beginning and my reasoning for using this name is that it would be easier for us to find all skipped tests with a simple query on dxr like this:

But now that I think about it more, linux64-ccov runs js code coverage as well and 'ccoverage' doesn't really represent that. I'll change it to 'ccov' so that it's easier to see that these tests are skipped on linux64-ccov and not linux64-jsdcov.
Fixed the commit message in the latest revision.
Assignee: nobody → gmierz2
Pushed by
Change mozinfo 'coverage' flag to 'ccov' to avoid ambiguity. r=ahal
Closed: 7 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla56
You need to log in before you can comment on or make changes to this bug.