1523193 - Intermittent toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/file_samp

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: rgurzau [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=224341874&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/W2GtmEs-Rni5drTmUlKt6w/runs/0/artifacts/public/logs/live_backing.log

[task 2019-01-27T19:15:29.791Z] 19:15:29 INFO - 221 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html
[task 2019-01-27T19:15:40.013Z] 19:15:40 INFO - Buffered messages logged at 19:15:26
[task 2019-01-27T19:15:40.014Z] 19:15:40 INFO - 222 INFO AddTask.js | Entering test test_contentscript_devtools_sandbox_metadata
[task 2019-01-27T19:15:40.015Z] 19:15:40 INFO - 223 INFO Extension loaded
[task 2019-01-27T19:15:40.016Z] 19:15:40 INFO - Buffered messages logged at 19:15:32
[task 2019-01-27T19:15:40.017Z] 19:15:40 INFO - 224 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | contentScript.executed
[task 2019-01-27T19:15:40.019Z] 19:15:40 INFO - 225 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | test result correct
[task 2019-01-27T19:15:40.020Z] 19:15:40 INFO - 226 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected array of globals
[task 2019-01-27T19:15:40.022Z] 19:15:40 INFO - 227 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected addonId
[task 2019-01-27T19:15:40.023Z] 19:15:40 INFO - 228 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected inner-window-id
[task 2019-01-27T19:15:40.024Z] 19:15:40 INFO - 229 INFO extension unloaded
[task 2019-01-27T19:15:40.024Z] 19:15:40 INFO - 230 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | No content scripts globals found once the extension is unloaded
[task 2019-01-27T19:15:40.024Z] 19:15:40 INFO - 231 INFO AddTask.js | Leaving test test_contentscript_devtools_sandbox_metadata
[task 2019-01-27T19:15:40.024Z] 19:15:40 INFO - Buffered messages finished
[task 2019-01-27T19:15:40.025Z] 19:15:40 INFO - 232 INFO TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/file_sample.html"]}
[task 2019-01-27T19:15:40.025Z] 19:15:40 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:7
[task 2019-01-27T19:15:40.025Z] 19:15:40 INFO - @toolkit/components/extensions/test/mochitest/head.js:34:7
[task 2019-01-27T19:15:40.025Z] 19:15:40 INFO - 233 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | took 8442ms

Comment 1

[Intermittent Failures Robot]

3 failures in 2383 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 2
• autoland: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-01-21&endday=2019-01-27&tree=all

Comment 2

[Intermittent Failures Robot]

44 failures in 2628 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #38 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 21
• mozilla-inbound: 6
• try: 11
• mozilla-beta: 3
• mozilla-central: 3

Platform breakdown:

• android-em-4-3-armv7-api16: 44

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 3

[Natalia Csoregi [:nataliaCs]]

r/b down to https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&searchStr=android%2C4.3%2Capi16%2B%2Copt%2Cmochitests%2Ctest-android-em-4.3-arm7-api-16%2Fopt-mochitest-24%2Cm%2824%29&revision=69a3d7c8d04bb6959e105b0c46d0aed4dda85ad9 - could be caused by https://bugzilla.mozilla.org/show_bug.cgi?id=1270059#c42 ?

Comment 4

[Intermittent Failures Robot]

58 failures in 2658 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #35 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 4
• mozilla-beta: 25
• autoland: 17
• mozilla-inbound: 10
• mozilla-central: 2

Platform breakdown:

• android-em-4-3-armv7-api16: 58

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 5

[Stefan Hindli [:stefan_hindli]]

Over the last 7 days this bug has 30 failures. These happen only on android-em-4-3-armv7-api16.

Here is the latest failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=228860897&repo=mozilla-inbound&lineNumber=2183

[task 2019-02-16T23:12:55.854Z] 23:12:55 INFO - Buffered messages logged at 23:12:40
[task 2019-02-16T23:12:55.855Z] 23:12:55 INFO - 236 INFO AddTask.js | Entering test test_contentscript_devtools_sandbox_metadata
[task 2019-02-16T23:12:55.855Z] 23:12:55 INFO - 237 INFO Extension loaded
[task 2019-02-16T23:12:55.855Z] 23:12:55 INFO - Buffered messages logged at 23:12:45
[task 2019-02-16T23:12:55.855Z] 23:12:55 INFO - 238 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | contentScript.executed
[task 2019-02-16T23:12:55.856Z] 23:12:55 INFO - 239 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | test result correct
[task 2019-02-16T23:12:55.856Z] 23:12:55 INFO - 240 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected array of globals
[task 2019-02-16T23:12:55.856Z] 23:12:55 INFO - 241 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected addonId
[task 2019-02-16T23:12:55.858Z] 23:12:55 INFO - 242 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Got the expected inner-window-id
[task 2019-02-16T23:12:55.858Z] 23:12:55 INFO - 243 INFO extension unloaded
[task 2019-02-16T23:12:55.860Z] 23:12:55 INFO - 244 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | No content scripts globals found once the extension is unloaded
[task 2019-02-16T23:12:55.861Z] 23:12:55 INFO - 245 INFO AddTask.js | Leaving test test_contentscript_devtools_sandbox_metadata
[task 2019-02-16T23:12:55.861Z] 23:12:55 INFO - Buffered messages finished
[task 2019-02-16T23:12:55.862Z] 23:12:55 INFO - 246 INFO TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/file_sample.html"]}
[task 2019-02-16T23:12:55.862Z] 23:12:55 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
[task 2019-02-16T23:12:55.862Z] 23:12:55 INFO - @toolkit/components/extensions/test/mochitest/head.js:34:7
[task 2019-02-16T23:12:55.863Z] 23:12:55 INFO - 247 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html | took 7547ms
[task 2019-02-16T23:12:55.863Z] 23:12:55 INFO - 248 ERROR /tests/toolkit/components/extensions/test/mochitest/test_ext_contentscript_devtools_metadata.html logged result after SimpleTest.finish(): Test left extra windows or tabs: {"extraWindows":[],"extraTabs":["http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/file_sample.html"]}
[task 2019-02-16T23:12:55.864Z] 23:12:55 INFO - 249 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_permission.html
[task 2019-02-16T23:13:06.082Z] 23:13:06 INFO - 250 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_contentscript_permission.html | took 17321ms
[task 2019-02-16T23:13:16.394Z] 23:13:16 INFO - 251 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies.html
[task 2019-02-16T23:13:26.823Z] 23:13:26 INFO - 252 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | took 12786ms
[task 2019-02-16T23:13:26.825Z] 23:13:26 INFO - 253 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies_containers.html
[task 2019-02-16T23:13:37.146Z] 23:13:37 INFO - 254 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies_containers.html | took 6202ms
[task 2019-02-16T23:13:37.147Z] 23:13:37 INFO - 255 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies_expiry.html
[task 2019-02-16T23:13:37.148Z] 23:13:37 INFO - 256 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies_expiry.html | took 3836ms
[task 2019-02-16T23:13:37.149Z] 23:13:37 INFO - 257 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies_first_party.html
[task 2019-02-16T23:13:47.479Z] 23:13:47 INFO - 258 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies_first_party.html | took 9225ms
[task 2019-02-16T23:13:47.481Z] 23:13:47 INFO - 259 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies_permissions_bad.html
[task 2019-02-16T23:14:08.120Z] 23:14:08 INFO - 260 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies_permissions_bad.html | took 20382ms
[task 2019-02-16T23:14:08.120Z] 23:14:08 INFO - 261 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_cookies_permissions_good.html
[task 2019-02-16T23:14:28.755Z] 23:14:28 INFO - 262 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies_permissions_good.html | took 18000ms
[task 2019-02-16T23:14:28.756Z] 23:14:28 INFO - 263 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_exclude_include_globs.html
[task 2019-02-16T23:14:49.401Z] 23:14:49 INFO - 264 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_exclude_include_globs.html | took 20224ms
[task 2019-02-16T23:14:49.401Z] 23:14:49 INFO - 265 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_external_messaging.html
[task 2019-02-16T23:14:59.723Z] 23:14:59 INFO - 266 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_external_messaging.html | took 7676ms
[task 2019-02-16T23:14:59.724Z] 23:14:59 INFO - 267 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_generate.html
[task 2019-02-16T23:14:59.725Z] 23:14:59 INFO - 268 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_generate.html | took 3204ms
[task 2019-02-16T23:14:59.725Z] 23:14:59 INFO - 269 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_idle.html
[task 2019-02-16T23:15:20.355Z] 23:15:20 INFO - 270 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_idle.html | took 18616ms

Comment 6

[Intermittent Failures Robot]

46 failures in 2832 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 23
• try: 5
• mozilla-beta: 10
• mozilla-inbound: 8

Platform breakdown:

• android-em-4-3-armv7-api16: 46

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 7

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1523193 - Disable test_ext_contentscript_devtools_metadata.html on android 4.3 !debug.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2525c940dd21
Disable test_ext_contentscript_devtools_metadata.html on android 4.3 !debug. r=jmaher

Comment 9

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/2525c940dd21

Comment 10

[Intermittent Failures Robot]

12 failures in 2602 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 6
• mozilla-inbound: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 11

[Intermittent Failures Robot]

14 failures in 2981 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 14

Platform breakdown:

• android-em-4-3-armv7-api16: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 12

[Intermittent Failures Robot]

11 failures in 2818 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 11

Platform breakdown:

• android-em-4-3-armv7-api16: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 13

[Intermittent Failures Robot]

8 failures in 2771 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 8

Platform breakdown:

• android-em-4-3-armv7-api16: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 2561 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 15

[Intermittent Failures Robot]

3 failures in 3910 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform breakdown:

• android-em-4-3-armv7-api16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 2843 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 4131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 18

[Intermittent Failures Robot]

2 failures in 4705 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform breakdown:

• android-em-4-3-armv7-api16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 19

[Intermittent Failures Robot]

17 failures in 627 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 17

Platform breakdown:

• linux1804-64-qr: 6
• windows10-64-qr: 2
• windows10-64: 1
• macosx1014-64: 4
• windows7-32: 2
• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2020-09-28&endday=2020-09-28&tree=all

Comment 20

[Intermittent Failures Robot]

17 failures in 4195 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 17

Platform breakdown:

• linux1804-64-qr: 6
• windows10-64-qr: 2
• windows10-64: 1
• macosx1014-64: 4
• windows7-32: 2
• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523193&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 21

[Shane Caraveo (:mixedpuppy)]

Test was since reenabled