1480680 - Intermittent Tier 2 devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last re

Status: RESOLVED FIXED

(DevTools :: Debugger, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=191786678&repo=mozilla-central

https://queue.taskcluster.net/v1/task/PfIRGA0IRlS5jdZ62-bpxQ/runs/0/artifacts/public/logs/live_backing.log

05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | One breakpoint exists - 
05:51:07     INFO - Invoking in tab: webpack3Babel6StepOverRegeneratorAwait()
05:51:07     INFO - Waiting for state change: paused
05:51:07     INFO - Buffered messages logged at 05:50:47
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xmlns." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xmlns." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
05:51:07     INFO - Buffered messages logged at 05:50:56
05:51:07     INFO - Finished waiting for state change: paused
05:51:07     INFO - Waiting for state change: selected source
05:51:07     INFO - Finished waiting for state change: selected source
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | top frame's source is selected - 
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | Line is highlighted as paused - 
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | There is only one line - 
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | debug line is visible - 
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | expression is highlighted as paused - 
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | gutter is visible - 
05:51:07     INFO - Waiting for REMOVE_BREAKPOINT to dispatch 1 time(s)
05:51:07     INFO - Buffered messages logged at 05:50:57
05:51:07     INFO - REMOVE_BREAKPOINT dispatched 1 time(s)
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | Breakpoint reverted - 
05:51:07     INFO - Resuming from 2
05:51:07     INFO - Buffered messages logged at 05:50:58
05:51:07     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | Ran tests for step-over-regenerator-await at line 2 column 2 - 
05:51:07     INFO - Leaving test bound 
05:51:07     INFO - Buffered messages logged at 05:51:06
05:51:07     INFO - Removing tab.
05:51:07     INFO - Waiting for event: 'TabClose' on [object XULElement].
05:51:07     INFO - Got event: 'TabClose' on [object XULElement].
05:51:07     INFO - Tab removed and finished closing
05:51:07     INFO - Buffered messages finished
05:51:07     INFO - TEST-UNEXPECTED-FAIL | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - 
05:51:07     INFO - GECKO(6400) | MEMORY STAT | vsize 2485MB | vsizeMaxContiguous 131890756MB | residentFast 506MB | heapAllocated 155MB
05:51:07     INFO - TEST-OK | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | took 384894ms
05:51:07     INFO - GECKO(6400) | ++DOCSHELL 000001F26C170800 == 1 [pid = 4528] [id = {a0007939-6fd3-409a-bb7d-25371579450c}]
05:51:07     INFO - GECKO(6400) | ++DOMWINDOW == 1 (000001F26FFB5280) [pid = 4528] [serial = 54] [outer = 0000000000000000]
05:51:07     INFO - GECKO(6400) | ++DOMWINDOW == 2 (000001F26FFCA400) [pid = 4528] [serial = 55] [outer = 000001F26FFB5280]

Comment 1

[Intermittent Failures Robot]

17 failures in 2579 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 17

Platform breakdown:
* windows10-64-ccov: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 2

[Intermittent Failures Robot]

9 failures in 2672 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 9

Platform breakdown:
* windows10-64-ccov: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 3

[Intermittent Failures Robot]

2 failures in 2568 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1
* try: 1

Platform breakdown:
* windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 2667 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 2

Platform breakdown:
* linux64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 5

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 6

[Narcis Beleuzu [:NarcisB]]

Fail reappeared on m-c

Log link: https://treeherder.mozilla.org/logviewer.html#?job_id=203303668&repo=mozilla-central&lineNumber=6933

Comment 7

[Intermittent Failures Robot]

21 failures in 2708 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 21

Platform breakdown:
* windows10-64-ccov: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 8

[Intermittent Failures Robot]

30 failures in 2740 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 30

Platform breakdown:
* windows10-64-ccov: 30

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-10-08&endday=2018-10-14&tree=all

Comment 9

[Bogdan Tara[:bogdan_tara | bogdant]]

In the last 7 days there have been 31 occurrences windows 10 64 ccov debug.

Comment 10

[Intermittent Failures Robot]

18 failures in 2759 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 18

Platform breakdown:
* windows10-64-ccov: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 11

[Intermittent Failures Robot]

4 failures in 2584 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 4

Platform breakdown:
* windows10-64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-10-22&endday=2018-10-28&tree=all

Comment 12

[Intermittent Failures Robot]

36 failures in 2978 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 36

Platform breakdown:
* windows10-64-ccov: 36

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-10-29&endday=2018-11-04&tree=all

Comment 13

[Andreea Pavel [:apavel]]

There are 40 total failures in the last 7 days, all of them on windows10-64-ccov.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=209940125&repo=mozilla-central&lineNumber=10702

00:08:24     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | Breakpoint reverted - 
00:08:24     INFO - Resuming from 2
00:08:24     INFO - Buffered messages logged at 00:08:15
00:08:24     INFO - Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xmlns." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 5811}]
00:08:24     INFO - Buffered messages logged at 00:08:16
00:08:24     INFO - TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | Ran tests for step-over-regenerator-await at line 2 column 2 - 
00:08:24     INFO - Leaving test bound 
00:08:24     INFO - Buffered messages logged at 00:08:24
00:08:24     INFO - Removing tab.
00:08:24     INFO - Waiting for event: 'TabClose' on [object XULElement].
00:08:24     INFO - Got event: 'TabClose' on [object XULElement].
00:08:24     INFO - Tab removed and finished closing
00:08:24     INFO - Buffered messages finished
00:08:24     INFO - TEST-UNEXPECTED-FAIL | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - 
00:08:24     INFO - GECKO(8516) | MEMORY STAT | vsize 2260MB | vsizeMaxContiguous 130814557MB | residentFast 479MB | heapAllocated 124MB
00:08:24     INFO - TEST-OK | devtools/client/debugger/new/test/mochitest/browser_dbg-sourcemapped-stepping.js | took 447265ms
00:08:24     INFO - GECKO(8516) | ++DOCSHELL 00000200D9A70800 == 1 [pid = 4876] [id = {83bbe411-bb15-434d-8045-bf6a9d22d536}]
00:08:24     INFO - GECKO(8516) | ++DOMWINDOW == 1 (00000200E091F800) [pid = 4876] [serial = 69] [outer = 0000000000000000]
00:08:24     INFO - GECKO(8516) | ++DOMWINDOW == 2 (00000200D9ACB000) [pid = 4876] [serial = 70] [outer = 00000200E091F800]
00:08:24     INFO - checking window state

This is a tier2 failure but has a high occurrence rate. 

Jason can you please take a look or assign someone? 
Joel, would disabling this test be a solution here?

Comment 14

[Joel Maher ( :jmaher ) (UTC -8)]

that is about 75% failure rate on win10-ccov; typically we would just disable that- lets see if :jlast is interested in extending the timeout- that is an option as well.

Comment 15

[Jason Laster [:jlast]]

happy to disable `win10-ccov`. honestly, it would be alright to disable ccov across the board for debugger tests...

Comment 16

[Eliza Balazs [:ebalazs_]]

Attachment: Skipped test on win10 ccov

Comment 17

[Joel Maher ( :jmaher ) (UTC -8)]

:jlast, thanks for the comment- we want to use coverage data to help us schedule relevant tests as well as finding areas we are missing.  If we can disable 5% of the tests and keep them running- that will give us good data,but if we find we are disabling hundreds of devtools tests, then I would prefer to keep it simple and not schedule devtools tests on ccov.

:apavel, want to write a patch to disable this?

Comment 18

[Joel Maher ( :jmaher ) (UTC -8)]

thanks Eliza :)

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/3d59ad835375
Disable browser_dbg-sourcemapped-stepping.js on win10 ccov for frequent failures. r=jmaher

Comment 20

[Jason Laster [:jlast]]

Makes sense :jmaher

Comment 21

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/3d59ad835375

Comment 22

[Intermittent Failures Robot]

8 failures in 3007 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 8

Platform breakdown:
* windows10-64-ccov: 7
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-11-05&endday=2018-11-11&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 1862 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 1008 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480680&startday=2018-12-24&endday=2018-12-30&tree=all