1463383 - Intermittent mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | Test timed out.

Reporter

Description

•

6 years ago

treeherder

Filed by: nbeleuzu [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=179607621&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/H9KnpxHfTmO5lsGF-mjBxA/runs/0/artifacts/public/logs/live_backing.log

Relevant log data: 

[task 2018-05-22T07:53:45.996Z] 07:53:45     INFO -  5 INFO TEST-START | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  Buffered messages logged at 07:53:43
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  6 INFO AddTask.js | Entering test test_popup_behavior
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  7 INFO Extension loaded
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  Buffered messages logged at 07:53:50
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  8 INFO TEST-PASS | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | browser action is shown
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  9 INFO Wait the new tabs to be loaded
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  Buffered messages finished
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  10 INFO TEST-UNEXPECTED-FAIL | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | Test timed out.
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  reportError@chrome://mochikit/content/tests/SimpleTest/TestRunner.js:121:7
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  TestRunner._checkForHangs@chrome://mochikit/content/tests/SimpleTest/TestRunner.js:142:7
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  11 INFO TEST-UNEXPECTED-FAIL | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | Extension left running at test shutdown
[task 2018-05-22T07:59:04.830Z] 07:59:04     INFO -  ExtensionTestUtils.loadExtension/<@chrome://mochikit/content/tests/SimpleTest/ExtensionTestUtils.js:109:7
[task 2018-05-22T07:59:04.831Z] 07:59:04     INFO -  executeCleanupFunction@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1227:19
[task 2018-05-22T07:59:04.832Z] 07:59:04     INFO -  SimpleTest.finish@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1240:5
[task 2018-05-22T07:59:04.832Z] 07:59:04     INFO -  killTest@chrome://mochikit/content/tests/SimpleTest/TestRunner.js:130:7
[task 2018-05-22T07:59:04.832Z] 07:59:04     INFO -  delayedKillTest@chrome://mochikit/content/tests/SimpleTest/TestRunner.js:157:47
[task 2018-05-22T07:59:04.833Z] 07:59:04     INFO -  12 INFO TEST-UNEXPECTED-FAIL | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | no tasks awaiting on messages - got "[\"page-loaded\"]", expected "[]"
[task 2018-05-22T07:59:04.833Z] 07:59:04     INFO -  SimpleTest.is@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:312:5
[task 2018-05-22T07:59:04.834Z] 07:59:04     INFO -  ExtensionTestUtils.loadExtension/<@chrome://mochikit/content/tests/SimpleTest/ExtensionTestUtils.js:31:7
[task 2018-05-22T07:59:04.834Z] 07:59:04     INFO -  executeCleanupFunction@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1227:19
[task 2018-05-22T07:59:04.835Z] 07:59:04     INFO -  13 INFO TEST-UNEXPECTED-FAIL | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://example.com/#test_popup_behavior_1","http://example.com/#test_popup_behavior_2","http://example.com/#test_popup_behavior_3"]}
[task 2018-05-22T07:59:04.835Z] 07:59:04     INFO -  @chrome://mochitests/content/chrome/mobile/android/components/extensions/test/mochitest/head.js:27:7
[task 2018-05-22T07:59:04.835Z] 07:59:04     INFO -  14 INFO TEST-OK | mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html | took 321648ms
[task 2018-05-22T07:59:15.153Z] 07:59:15     INFO -  15 INFO Error: Unable to restore focus, expect failures and timeouts.
[task 2018-05-22T07:59:15.153Z] 07:59:15     INFO -  16 ERROR chrome://mochitests/content/chrome/mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html logged result after SimpleTest.finish(): Extension left running at test shutdown
[task 2018-05-22T07:59:15.153Z] 07:59:15     INFO -  17 ERROR chrome://mochitests/content/chrome/mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html logged result after SimpleTest.finish(): no tasks awaiting on messages
[task 2018-05-22T07:59:15.154Z] 07:59:15     INFO -  18 ERROR chrome://mochitests/content/chrome/mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html logged result after SimpleTest.finish(): Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://example.com/#test_popup_behavior_1","http://example.com/#test_popup_behavior_2","http://example.com/#test_popup_behavior_3"]}

Comment hidden (Intermittent Failures Robot)

17 failures in 111 pushes (0.153 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 17

Platform breakdown:
* android-4-3-armv7-api16: 13
* android-4-2-x86: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-22&endday=2018-05-22&tree=trunk

Comment hidden (Intermittent Failures Robot)

41 failures in 104 pushes (0.394 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 19
* autoland: 18
* try: 2
* mozilla-central: 2

Platform breakdown:
* android-4-3-armv7-api16: 24
* android-4-2-x86: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-23&endday=2018-05-23&tree=trunk

Cristina Coroiu [:ccoroiu]

Comment 3

•

6 years ago

Did some retriggers for c4 fail:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-searchStr=Android%204.3%20API16%2B%20opt%20Mochitests%20test-android-4.3-arm7-api-16%2Fopt-mochitest-chrome-4%20M(c4)&tochange=bfdfd3388e9a17d65a81ddbdc4fc669ab2887b3a&fromchange=7614c38e5c0f7b3e8e0d34c3cf05f5a2bdac0789&selectedJob=179610393

Found this push as culprit:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=bfdfd3388e9a17d65a81ddbdc4fc669ab2887b3a&filter-searchStr=Android%204.3%20API16%20%20opt%20Mochitests%20test-android-4.3-arm7-api-16%2Fopt-mochitest-chrome-4%20M(c4)

Looking in mercurial and searching after test_ext_popup_behavior.html file, found this push:
https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?changeset=c10c705a1fea

:jmaher could you please take a look?

Flags: needinfo?(jmaher)

Eliza Balazs [:ebalazs_]

Updated

•

6 years ago

Whiteboard: [stockwell needswork:owner] → [stockwell needswork:owner][retriggered]

Joel Maher ( :jmaher ) (UTC -8)

Comment 4

•

6 years ago

there are 4 bugs that landed at the same time:
https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?changeset=bfdfd3388e9a


given that this is failing 25% of the time (6 failures out of 24 runs), I vote for backing this out?  Keep in mind this is already a long running task ~40 seconds for this test on android previously- so the timeout could be a slight shift in runtime.

:kmag, can you fix this test, backout, or disable the test for android?

Flags: needinfo?(jmaher) → needinfo?(kmaglione+bmo)

Comment hidden (Intermittent Failures Robot)

47 failures in 109 pushes (0.431 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 25
* mozilla-inbound: 18
* mozilla-central: 4

Platform breakdown:
* android-4-3-armv7-api16: 30
* android-4-2-x86: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-24&endday=2018-05-24&tree=trunk

Cristina Coroiu [:ccoroiu]

Comment 6

•

6 years ago

:kmag could you please take a look?

Comment hidden (Intermittent Failures Robot)

46 failures in 143 pushes (0.322 failures/push) were associated with this bug yesterday.    

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* autoland: 25
* mozilla-inbound: 14
* mozilla-central: 5
* try: 2

Platform breakdown:
* android-4-3-armv7-api16: 28
* android-4-2-x86: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-25&endday=2018-05-25&tree=trunk

Comment hidden (Intermittent Failures Robot)

23 failures in 49 pushes (0.469 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 9
* mozilla-central: 7
* mozilla-inbound: 6
* try: 1

Platform breakdown:
* android-4-2-x86: 13
* android-4-3-armv7-api16: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-26&endday=2018-05-26&tree=trunk

Cosmin Sabou [:CosminS]

Comment 9

•

6 years ago

Attached patch Disable on Android and !debug — Details — Splinter Review

Attachment #8980950 - Flags: review?(nbeleuzu)

Narcis Beleuzu [:NarcisB]

Updated

•

6 years ago

Attachment #8980950 - Flags: review?(nbeleuzu) → review+

Pulsebot

Comment 10

•

6 years ago

Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/698b35dd4f6a
Disable mobile/android/components/extensions/test/mochitest/test_ext_popup_behavior.html for frequent timeouts. r=nbeleuzu

Cosmin Sabou [:CosminS]

Updated

•

6 years ago

Keywords: leave-open

Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered][stockwell disabled]

Cosmin Sabou [:CosminS]

Comment 11

•

6 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/698b35dd4f6a

Comment hidden (Intermittent Failures Robot)

193 failures in 632 pushes (0.305 failures/push) were associated with this bug in the last 7 days. 

This is the #8 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 86
* mozilla-inbound: 80
* mozilla-central: 18
* try: 9

Platform breakdown:
* android-4-3-armv7-api16: 119
* android-4-2-x86: 74

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-05-21&endday=2018-05-27&tree=trunk

BMO Automation

Updated

•

6 years ago

Product: Toolkit → WebExtensions

Comment hidden (Intermittent Failures Robot)

1 failures in 521 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* android-4-2-x86: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1463383&startday=2018-06-18&endday=2018-06-24&tree=trunk

Kris Maglione [:kmag]

Updated

•

6 years ago

Flags: needinfo?(kmaglione+bmo)

Luca Greco [:rpl] [:luca] [:lgreco]

Updated

•

5 years ago

Priority: -- → P5

Shane Caraveo (:mixedpuppy)

Comment 14

•

3 years ago

test_ext_popup_behavior.html no longer exists, probably changed names, but closing this.

Status: NEW → RESOLVED

Closed: 3 years ago

Resolution: --- → WONTFIX

BugBot [:suhaib / :marco/ :calixte]

Updated

•

3 years ago

Keywords: leave-open