Closed Bug 1301214 Opened 8 years ago Closed 8 years ago

Enable collection of devtools c++ code coverage with GCOV and create a devtools task for linux64-ccov.

Categories

(Testing :: Code Coverage, defect)

defect
Not set
normal

Tracking

(firefox52 fixed)

RESOLVED FIXED
mozilla52
Tracking Status
firefox52 --- fixed

People

(Reporter: sparky, Assigned: cody_tran95)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

We'd like to be able to collect c++ code coverage for devtools. To get this working I believe we'd have to enable it to use the "--code-coverage" flag just like it is done for browser-chrome. It may in fact work already as devtools and browser-chrome are both in mochitest.
Blocks: 1301170
Blocks: 1301219
Status: UNCONFIRMED → NEW
Ever confirmed: true
I think here we just need to define the test to run against a linux64-ccov build (in test.yml) and pass the proper flag to mochitest to enable and manage settings for coverage (this is only needed for JSVM which we should do).
once we get the ccov builds properly supported in the tree and on try only, we just need to verify on try and land any changes to test.yml configuration.
Assignee: nobody → bk
Assignee: bk → cody_tran95
Comment on attachment 8803110 [details]
Bug 1301214 - Changed action of code coverage options to store_true and enabled code coverage for mochitest-devtools-chrome.

https://reviewboard.mozilla.org/r/87328/#review86380

I think this is great, nice work! There are only a few small things to take care of before it's ready.

::: taskcluster/ci/desktop-test/tests.yml:285
(Diff revision 1)
>      max-run-time: 5400
>      chunks: 10
> +    run-on-projects:
> +        by-test-platform:
> +            linux64-ccov/opt: []
> +            default: ['all']
>      e10s:
>          by-test-platform:
>              # Bug 1242986: linux64/debug mochitest-devtools-chrome e10s is not greened up yet
>              linux64/debug: false
> +            linux64-ccov/opt: false
>              default: both
> +    max-run-time:

Duplicate declaration of the max-run-time attribute here.

::: taskcluster/ci/desktop-test/tests.yml:299
(Diff revision 1)
>              linux64/debug: false
> +            linux64-ccov/opt: false
>              default: both
> +    max-run-time:
> +        by-test-platform:
> +            linux64-ccov/opt: 7200

Is 2 hours necessary or can we reduce the max-run-time?

::: taskcluster/ci/desktop-test/tests.yml:321
(Diff revision 1)
> -            - --mochitest-suite=mochitest-devtools-chrome-chunked
> +                    - --mochitest-suite=mochitest-devtools-chrome-chunked
>      instance-size:
>          by-test-platform:
>              # Bug 1281241: migrating to m3.large instances
>              linux64-asan/opt: legacy
> +            linux64-ccov/opt: xlarge

I believe mochitest-bc needed this extra large instance because it had bugs otherwise. Do we also get bugs in devtools if we use a smaller instance?
Attachment #8803110 - Flags: review?(gmierz2) → review-
Comment on attachment 8803110 [details]
Bug 1301214 - Changed action of code coverage options to store_true and enabled code coverage for mochitest-devtools-chrome.

https://reviewboard.mozilla.org/r/87328/#review86530

assuming you validate the instance type we need (as per Greg's review comment), the rest looks good.
Attachment #8803110 - Flags: review?(jmaher) → review+
Summary: Enable collection of devtools c++ code coverage with GCOV. → Enable collection of devtools c++ code coverage with GCOV and create a devtools task for linux64-ccov.
Comment on attachment 8803110 [details]
Bug 1301214 - Changed action of code coverage options to store_true and enabled code coverage for mochitest-devtools-chrome.

https://reviewboard.mozilla.org/r/87328/#review86380

> Is 2 hours necessary or can we reduce the max-run-time?

Pushed to try with default time of 5400 and that seemed to work

https://treeherder.mozilla.org/#/jobs?repo=try&revision=d65a467e35a2

> I believe mochitest-bc needed this extra large instance because it had bugs otherwise. Do we also get bugs in devtools if we use a smaller instance?

Changed to default and it worked.
Comment on attachment 8803110 [details]
Bug 1301214 - Changed action of code coverage options to store_true and enabled code coverage for mochitest-devtools-chrome.

https://reviewboard.mozilla.org/r/87328/#review87468

Good work Cody! It's good to go now in my opinion.
Attachment #8803110 - Flags: review?(gmierz2) → review+
can you rebase this commit?  autoland failed to rebase, can you do it manually and then repush to mozreview?

here are some general guidelines and you can find the rebase stuff on there:
http://mozilla-version-control-tools.readthedocs.io/en/latest/hgmozilla/firefoxworkflow.html
Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e36c5db0191e
Changed action of code coverage options to store_true and enabled code coverage for mochitest-devtools-chrome. r=gmierz2+560562,jmaher
https://hg.mozilla.org/mozilla-central/rev/e36c5db0191e
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla52
You need to log in before you can comment on or make changes to this bug.