1544470 - Collect CPU usage information during test runs on Android devices

Status: RESOLVED FIXED

(Testing :: Performance, enhancement)

Description

[Chris Hartjes [:grumpy][:chartjes]]

Extend Raptor to collect CPU usage information when browser tests are run on Android devices.

Comment 1

[Chris Hartjes [:grumpy][:chartjes]]

Attachment: Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r?rwood,davehunt

Comment 2

[Chris Hartjes [:grumpy][:chartjes]]

Attachment: Bug 1544470 - Refactored code that measures CPU usage for Android using Raptor to match work done for memory usage, now available to use as a CLI parameter; r?rwood

Depends on D27954

Comment 3

[Chris Hartjes [:grumpy][:chartjes]]

Try for these changes -> https://treeherder.mozilla.org/#/jobs?repo=try&revision=177d731a72e6571b96b9d14204370d8b3fbb5847

Comment 4

[Chris Hartjes [:grumpy][:chartjes]]

Try for latest set of changes -> https://treeherder.mozilla.org/#/jobs?repo=try&revision=1ef8faa2f0762d74794b5ed8a8bf4d9ec6d89f1e

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ba9d948d404c
Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood

Comment 6

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/ba9d948d404c

Comment 7

[Andreea Pavel [:apavel]]

Backed out for breaking raptor chromium

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&group_state=expanded&selectedJob=245700549&revision=a42caa9f04fc41044437ac56eab6f6086c841d9f

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=245700549&repo=mozilla-central&lineNumber=598

Backout: https://hg.mozilla.org/mozilla-central/rev/5d2aa419a72c9078f3c82d21da7638d9ce8f2006

Comment 8

[Chris Hartjes [:grumpy][:chartjes]]

New try runs with the latest patch ->

Speedometer Android -> https://treeherder.mozilla.org/#/jobs?repo=try&revision=fa665502813763c5887394cf0a7ca4d2d809a9c3
Speedometer Chromium -> https://treeherder.mozilla.org/#/jobs?repo=try&revision=c4ae887904d7655c6e99a6b2ae4eebb07e0c2e05
Speedometer Firefox -> https://treeherder.mozilla.org/#/jobs?repo=try&revision=69bd3739669e420d95c970ae167633dc29d01b6a

All appear to have passed with no failures.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9137795c6779
Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood

Comment 10

[Noemi Erli[:noemi_erli]]

Backed out changeset 9137795c6779 (Bug 1544470) for linting failure in raptor.py CLOSED TREE

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&revision=9137795c6779e2262268b7f7be7c76b97e4d092b&selectedJob=249227331

Failure logs:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=249227331&repo=autoland&lineNumber=255
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=249227267&repo=autoland&lineNumber=316

Backout: https://hg.mozilla.org/integration/autoland/rev/ce2035e996125bbed78d49d9cdba00f4517fcf8b

Comment 11

[Chris Hartjes [:grumpy][:chartjes]]

:noemi_erli - Acknowledged, will fix

Comment 12

[Chris Hartjes [:grumpy][:chartjes]]

Try runs that pass:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=bdb465150729cf42ba7785e5d5c7639fd167577c

Code submitted to Phabricator for more review

Comment 13

[Chris Hartjes [:grumpy][:chartjes]]

Attachment: Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices

Comment 14

[Chris Hartjes [:grumpy][:chartjes]]

Try runs verifying that code executes without causing errors

https://treeherder.mozilla.org/#/jobs?repo=try&revision=6b639a0db18777c8b3b99f53ebd32712c6b71dd4
https://treeherder.mozilla.org/#/jobs?repo=try&revision=fa28dd1e0e4b59fde72fc28990c7f9bb8c40dee5

Android run timed out, I have submitted another job

https://treeherder.mozilla.org/#/jobs?repo=try&revision=d7c8e4abc81adae33cda386b8fb481e4952b08d3

Comment 15

[Chris Hartjes [:grumpy][:chartjes]]

Try job for Android passed https://treeherder.mozilla.org/#/jobs?repo=try&revision=c4d96d98ef99f72041db5bcb35c5864defe88c87

Will land code later today.

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/148d730f2b78
Added in code that can be used to take a snapshot of CPU usage on Android devices r=rwood,davehunt

Comment 17

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/148d730f2b78