1512741 - Intermittent TEST-UNEXPECTED-TIMEOUT | toolkit/components/extensions/test/xpcshell/test_ext_userScripts.js | Test timed out

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=215936245&repo=autoland

https://queue.taskcluster.net/v1/task/UF_psMc6Trq_E31-Dn8JKg/runs/0/artifacts/public/logs/live_backing.log

[task 2018-12-07T16:29:43.325Z] 16:29:43     INFO - Killing every process called emulator64-arm
[task 2018-12-07T16:29:43.336Z] 16:29:43     INFO - Killing pid 471.
[task 2018-12-07T16:29:43.337Z] 16:29:43     INFO - [mozharness: 2018-12-07 16:29:43.336948Z] Finished run-tests step (success)
[task 2018-12-07T16:29:43.337Z] 16:29:43     INFO - Running post-run listener: _resource_record_post_run
[task 2018-12-07T16:29:43.534Z] 16:29:43     INFO - Total resource usage - Wall time: 3518s; CPU: 25.0%; Read bytes: 110592; Write bytes: 1210191872; Read time: 24; Write time: 211328
[task 2018-12-07T16:29:43.534Z] 16:29:43     INFO - TinderboxPrint: CPU usage<br/>24.8%
[task 2018-12-07T16:29:43.534Z] 16:29:43     INFO - TinderboxPrint: I/O read bytes / time<br/>110,592 / 24
[task 2018-12-07T16:29:43.534Z] 16:29:43     INFO - TinderboxPrint: I/O write bytes / time<br/>1,210,191,872 / 211,328
[task 2018-12-07T16:29:43.535Z] 16:29:43     INFO - TinderboxPrint: CPU idle<br/>10,506.7 (75.1%)
[task 2018-12-07T16:29:43.536Z] 16:29:43     INFO - TinderboxPrint: CPU user<br/>3,457.1 (24.7%)
[task 2018-12-07T16:29:43.536Z] 16:29:43     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2018-12-07T16:29:43.539Z] 16:29:43     INFO - verify-device - Wall time: 5s; CPU: 5.0%; Read bytes: 0; Write bytes: 21512192; Read time: 0; Write time: 10084
[task 2018-12-07T16:29:43.543Z] 16:29:43     INFO - install - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2018-12-07T16:29:43.584Z] 16:29:43     INFO - run-tests - Wall time: 3513s; CPU: 25.0%; Read bytes: 110592; Write bytes: 1188679680; Read time: 24; Write time: 201244
[task 2018-12-07T16:29:44.700Z] 16:29:44  WARNING - returning nonzero exit status 1
[task 2018-12-07T16:29:44.735Z] cleanup
[task 2018-12-07T16:29:44.735Z] + cleanup
[task 2018-12-07T16:29:44.735Z] + local rv=1
[task 2018-12-07T16:29:44.735Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2018-12-07T16:29:44.735Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log
[task 2018-12-07T16:29:44.736Z] + true
[task 2018-12-07T16:29:44.736Z] + cleanup_xvfb
[task 2018-12-07T16:29:44.737Z] pidof Xvfb
[task 2018-12-07T16:29:44.737Z] ++ pidof Xvfb
[task 2018-12-07T16:29:44.741Z] + local xvfb_pid=25
[task 2018-12-07T16:29:44.741Z] + local vnc=false
[task 2018-12-07T16:29:44.741Z] + local interactive=false
[task 2018-12-07T16:29:44.741Z] + '[' -n 25 ']'
[task 2018-12-07T16:29:44.741Z] + [[ false == false ]]
[task 2018-12-07T16:29:44.741Z] + [[ false == false ]]
[task 2018-12-07T16:29:44.741Z] + kill 25
[task 2018-12-07T16:29:44.741Z] + screen -XS xvfb quit
[task 2018-12-07T16:29:44.746Z] XIO:  fatal IO error 11 (Resource temporarily unavailable) on X server ":0"
[task 2018-12-07T16:29:44.752Z]       after 1066 requests (1066 known processed) with 0 events remaining.
[task 2018-12-07T16:29:44.753Z] compizconfig - Info: Backend     : ini
[task 2018-12-07T16:29:44.753Z] compizconfig - Info: Integration : true
[task 2018-12-07T16:29:44.753Z] compizconfig - Info: Profile     : default
[task 2018-12-07T16:29:44.917Z] No screen session found.
[task 2018-12-07T16:29:44.917Z] + true
[task 2018-12-07T16:29:44.917Z] + exit 1
[taskcluster 2018-12-07 16:29:45.280Z] === Task Finished ===
[taskcluster 2018-12-07 16:29:53.930Z] Unsuccessful task run with exit code: 1 completed in 3628.628 seconds

Comment 1

[Intermittent Failures Robot]

8 failures in 1862 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1
* autoland: 7

Platform breakdown:
* android-em-4-3-armv7-api16: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

[task 2018-12-07T16:24:32.814Z] 16:24:32     INFO -  TEST-START | xpcshell.ini:toolkit/components/extensions/test/xpcshell/test_ext_userScripts.js
[task 2018-12-07T16:29:32.816Z] 16:29:32  WARNING -  TEST-UNEXPECTED-TIMEOUT | xpcshell.ini:toolkit/components/extensions/test/xpcshell/test_ext_userScripts.js | Test timed out
[task 2018-12-07T16:29:32.816Z] 16:29:32     INFO -  TEST-INFO took 300000ms
[task 2018-12-07T16:29:33.223Z] 16:29:33     INFO -  xpcshell return code: -1
[task 2018-12-07T16:29:43.287Z] 16:29:43  WARNING -  TEST-UNEXPECTED-FAIL | Received SIGINT (control-C), so stopped run. (Use --keep-going to keep running tests after killing one with SIGINT)

Comment 3

[Intermittent Failures Robot]

6 failures in 2485 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 4
* mozilla-inbound: 2

Platform breakdown:
* android-em-4-3-armv7-api16: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2018-12-10&endday=2018-12-16&tree=all

Comment 4

[Intermittent Failures Robot]

8 failures in 2648 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 2
* mozilla-inbound: 1
* autoland: 5

Platform breakdown:
* android-em-4-3-armv7-api16: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2018-12-17&endday=2018-12-23&tree=all

Comment 5

[Intermittent Failures Robot]

5 failures in 1008 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* autoland: 4

Platform breakdown:
* android-em-4-3-armv7-api16: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2018-12-24&endday=2018-12-30&tree=all

Comment 6

[Intermittent Failures Robot]

6 failures in 1668 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* autoland: 4

Platform breakdown:
* android-em-4-3-armv7-api16: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2018-12-31&endday=2019-01-06&tree=all

Comment 7

[Dorel Luca [:dluca]]

This bug has failed 37 times in the last 7 days. Occurs on android-em-4-3-armv7-api16 on debug build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=221442943&repo=autoland&lineNumber=1699

ddurst:

Can you please take a look at this bug?

Comment 8

[Intermittent Failures Robot]

21 failures in 432 pushes (0.049 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 2
• try: 2
• mozilla-inbound: 5
• autoland: 12

Platform breakdown:

• android-em-4-3-armv7-api16: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-11&endday=2019-01-11&tree=all

Comment 9

[Intermittent Failures Robot]

44 failures in 2627 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 25
• mozilla-inbound: 11
• try: 2
• mozilla-central: 6

Platform breakdown:

• android-em-4-3-armv7-api16: 44

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-07&endday=2019-01-13&tree=all

Comment 10

[Narcis Beleuzu [:NarcisB]]

There are 78 failures in the last 7 days.
Jolin, the fail started from Bug 1495053 - https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C4.3%2Capi16%2B%2Cdebug%2Cxpcshell%2Ctests%2Ctest-android-em-4.3-arm7-api-16%2Fdebug-xpcshell-11%2Cx%28x11%29&tochange=8442297c6818db346c8252914f7d69fd68094f10&fromchange=ffb2ef47c53699f188ab5f316f3285f8a012e743

Could you please take a look?

Comment 11

[Intermittent Failures Robot]

38 failures in 381 pushes (0.1 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 8
• autoland: 29
• try: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-14&endday=2019-01-14&tree=all

Comment 12

[John Lin [:jhlin][:jolin]]

(In reply to Narcis Beleuzu [:NarcisB] from comment #10)

There are 78 failures in the last 7 days.
Jolin, the fail started from Bug 1495053 - https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C4.3%2Capi16%2B%2Cdebug%2Cxpcshell%2Ctests%2Ctest-android-em-4.3-arm7-api-16%2Fdebug-xpcshell-11%2Cx%28x11%29&tochange=8442297c6818db346c8252914f7d69fd68094f10&fromchange=ffb2ef47c53699f188ab5f316f3285f8a012e743

Could you please take a look?

I don't see how changes for CDM support would ever affect the WebExtensions test results. The code in those patches won't be executed unless a specific EME API [1] is used. Could it be other changes before that?

[1] https://w3c.github.io/encrypted-media/#dom-mediakeys-setservercertificate

Comment 13

[Intermittent Failures Robot]

41 failures in 473 pushes (0.087 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 32
• mozilla-central: 2
• mozilla-inbound: 7

Platform breakdown:

• android-em-4-3-armv7-api16: 41

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-15&endday=2019-01-15&tree=all

Comment 14

[Intermittent Failures Robot]

29 failures in 442 pushes (0.066 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-inbound: 7
• mozilla-central: 1
• autoland: 21

Platform breakdown:

• android-em-4-3-armv7-api16: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-16&endday=2019-01-16&tree=all

Comment 15

[Stefan Hindli [:stefan_hindli]]

Attachment: Disabled test_ext_userScripts.js on Android debug for frequent failures.

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/de8ba06db792
disable test_ext_userScripts.js on Android debug for frequent failures. r=jmaher

Comment 17

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/de8ba06db792

Comment 18

[Intermittent Failures Robot]

18 failures in 476 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• try: 2
• mozilla-inbound: 3
• mozilla-central: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-17&endday=2019-01-17&tree=all

Comment 19

[Intermittent Failures Robot]

126 failures in 2378 pushes (0.053 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 94
• try: 3
• mozilla-inbound: 25
• mozilla-central: 4

Platform breakdown:

• android-em-4-3-armv7-api16: 126

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1512741&startday=2019-01-14&endday=2019-01-20&tree=all

Comment 20

[Luca Greco [:rpl] [:luca] [:lgreco]]

Attachment: Bug 1512741 - Split userScripts xpcshell test and re-enable it on android debug build. r?robwu!

This patch move the part of test_ext_userScripts.js that is testing the userScripts' export API helpers
(script.defineGlobals and script.export) into a separate test_ext_userScripts_exports.js test file.

Based on the logs from the intermittent failures of the test_ext_userScripts.js test file
on android debug builds, it seems that this xpcshell test was just timing out while exiting after all
the test tasks were actually completed.

The results got from pushing to try this patch seems to confirm that once the test tasks are splitted
over two test files, the intermittent failures are not being triggered anymore on the android debug
builds.

Comment 21

[Luca Greco [:rpl] [:luca] [:lgreco]]

Push to try of the attached patch (running test-android-em-4.3-arm7-api-16/debug-xpcshell-11 for 5 times, to double check that the intermittent failures tracked by this issue is not being triggered with the changes described in comment 20):

• https://treeherder.mozilla.org/#/jobs?repo=try&revision=1a14439647aef5c4d143997f91a6561e6816c0ae

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4f629b83e01b
Split userScripts xpcshell test and re-enable it on android debug build. r=robwu

Comment 23

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/4f629b83e01b

Comment 24

[Luca Greco [:rpl] [:luca] [:lgreco]]

Marked as fixed, as this test has been splitted into two test files and re-enabled (comment 23).