1543902 - Intermittent test/browser/browser_aboutdebugging_devtoolstoolbox_reload.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. -

Status: RESOLVED FIXED

(DevTools :: about:debugging, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: shindli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=239844022&repo=mozilla-central

https://queue.taskcluster.net/v1/task/JDuKCdo6TSiFhjutPMenWA/runs/0/artifacts/public/logs/live_backing.log

[task 2019-04-12T04:41:37.848Z] 04:41:37 INFO - TEST-PASS | devtools/client/aboutdebugging-new/test/browser/browser_aboutdebugging_devtoolstoolbox_reload.js | Toolbox is re-created again -
[task 2019-04-12T04:41:37.848Z] 04:41:37 INFO - Check whether about:devtools-toolbox page displays correctly
[task 2019-04-12T04:41:37.849Z] 04:41:37 INFO - TEST-PASS | devtools/client/aboutdebugging-new/test/browser/browser_aboutdebugging_devtoolstoolbox_reload.js | about:devtools-toolbox page displays correctly -
[task 2019-04-12T04:41:37.849Z] 04:41:37 INFO - Close about:devtools-toolbox page
[task 2019-04-12T04:41:37.850Z] 04:41:37 INFO - Wait for removeTab
[task 2019-04-12T04:41:37.851Z] 04:41:37 INFO - Removing tab.
[task 2019-04-12T04:41:37.851Z] 04:41:37 INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2019-04-12T04:41:37.852Z] 04:41:37 INFO - Got event: 'TabClose' on [object XULElement].
[task 2019-04-12T04:41:37.852Z] 04:41:37 INFO - Tab removed and finished closing
[task 2019-04-12T04:41:37.853Z] 04:41:37 INFO - Wait for toolbox destroyed
[task 2019-04-12T04:41:37.853Z] 04:41:37 INFO - Buffered messages logged at 04:41:36
[task 2019-04-12T04:41:37.854Z] 04:41:37 INFO - Wait until aboutdebugging is selected
[task 2019-04-12T04:41:37.855Z] 04:41:37 INFO - Wait until about:devtools-toolbox is removed from debug targets
[task 2019-04-12T04:41:37.855Z] 04:41:37 INFO - Removing tab.
[task 2019-04-12T04:41:37.855Z] 04:41:37 INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2019-04-12T04:41:37.856Z] 04:41:37 INFO - Got event: 'TabClose' on [object XULElement].
[task 2019-04-12T04:41:37.856Z] 04:41:37 INFO - Buffered messages logged at 04:41:37
[task 2019-04-12T04:41:37.857Z] 04:41:37 INFO - Tab removed and finished closing
[task 2019-04-12T04:41:37.857Z] 04:41:37 INFO - Leaving test bound
[task 2019-04-12T04:41:37.858Z] 04:41:37 INFO - Buffered messages finished
[task 2019-04-12T04:41:37.858Z] 04:41:37 INFO - TEST-UNEXPECTED-FAIL | devtools/client/aboutdebugging-new/test/browser/browser_aboutdebugging_devtoolstoolbox_reload.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. -
[task 2019-04-12T04:41:37.859Z] 04:41:37 INFO - GECKO(1088) | MEMORY STAT | vsize 3697MB | residentFast 804MB | heapAllocated 215MB
[task 2019-04-12T04:41:37.859Z] 04:41:37 INFO - TEST-OK | devtools/client/aboutdebugging-new/test/browser/browser_aboutdebugging_devtoolstoolbox_reload.js | took 466437ms
[task 2019-04-12T04:41:37.860Z] 04:41:37 INFO - GECKO(1088) | ++DOCSHELL 0x7f6afa006800 == 1 [pid = 1226] [id = {56d82a74-8976-4a06-8e92-b560587a9295}]
[task 2019-04-12T04:41:37.860Z] 04:41:37 INFO - GECKO(1088) | ++DOMWINDOW == 1 (0x7f6afd52ef20) [pid = 1226] [serial = 22] [outer = (nil)]
[task 2019-04-12T04:41:37.861Z] 04:41:37 INFO - GECKO(1088) | ++DOMWINDOW == 2 (0x7f6afd7afc00) [pid = 1226] [serial = 23] [outer = 0x7f6afd52ef20]
[task 2019-04-12T04:41:37.861Z] 04:41:37 INFO - GECKO(1088) | ++DOMWINDOW == 3 (0x7f6afd7b1c00) [pid = 1226] [serial = 24] [outer = 0x7f6afd52ef20]
[task 2019-04-12T04:41:37.862Z] 04:41:37 INFO - checking window state
[task 2019-04-12T04:41:37.862Z] 04:41:37 INFO - TEST-START | devtools/client/aboutdebugging-new/test/browser/browser_aboutdebugging_devtoolstoolbox_shortcuts.js

Comment 1

[Bogdan Tara[:bogdan_tara | bogdant]]

This seems to perma fail on tier 2:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&fromchange=c261aea0226a3f60a31923b9a98e80826eb18833&searchStr=windows%2C10%2Cx64%2Cccov%2Cdebug%2Cmochitests%2Cwith%2Ce10s%2Ctest-windows10-64-ccov%2Fdebug-mochitest-devtools-chrome-e10s-5%2Cm-e10s%28dt5%29&tochange=412447b6149e347e8745b1480537726b0c5b02a5&selectedJob=240020613

Comment 2

[Intermittent Failures Robot]

26 failures in 529 pushes (0.049 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 26

Platform breakdown:

• linux64-ccov: 7
• windows10-64-ccov: 18
• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543902&startday=2019-04-12&endday=2019-04-12&tree=all

Comment 3

[Intermittent Failures Robot]

37 failures in 3025 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 37

Platform breakdown:

• linux64-ccov: 11
• windows10-64-ccov: 18
• windows10-aarch64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543902&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 4

[Stefan Hindli [:stefan_hindli]]

Over the last 7 days there are 38 failures present on this bug. These happen on linux64-ccov, windows10-64-ccov.

Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=241637112&repo=mozilla-central&lineNumber=3765

Comment 5

[Intermittent Failures Robot]

46 failures in 2673 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 46

Platform breakdown:

• linux64-ccov: 28
• windows10-64-ccov: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543902&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 6

[Julian Descottes [:jdescottes]]

The test finishes correctly but it's too slow for those platforms.

There is no real added value in running this test for code coverage, because it just load tools several times. We are not exercising a specific feature of any tool, we are rather checking for race conditions when reloading. Skipping on code coverage should not have any impact on the actual code coverage for devtools.

Comment 7

[Julian Descottes [:jdescottes]]

Attachment: Bug 1543902 - Skip browser_aboutdebugging_devtoolstoolbox_reload on ccov platforms

The test finishes correctly but it's too slow for those platforms.

There is no real added value in running this test for code coverage, because it just load tools several times.
We are not exercising a specific feature of any tool, we are rather checking for race conditions when reloading.
Skipping on code coverage should not have any impact on the actual code coverage for devtools.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/792827e182fc
Skip browser_aboutdebugging_devtoolstoolbox_reload on ccov platforms r=daisuke

Comment 9

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/792827e182fc

Comment 10

[Intermittent Failures Robot]

14 failures in 3031 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14

Platform breakdown:

• linux64-ccov: 10
• windows10-64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543902&startday=2019-04-22&endday=2019-04-28&tree=all