1459789 - Intermittent devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | Test timed out -

Status: RESOLVED FIXED

(DevTools :: Debugger, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=177367820&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/H-p6yk2ESgWDl-n4Ey_iUw/runs/0/artifacts/public/logs/live_backing.log

00:30:22     INFO -  218 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  219 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  220 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xmlns." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  221 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  222 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xlink." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  223 INFO Console message: [JavaScript Warning: "Removed unsafe attribute. Element: svg. Attribute: xmlns." {file: "resource://devtools/shared/base-loader.js -> resource://devtools/client/shared/vendor/react-dom.js" line: 11623}]
00:30:22     INFO -  Buffered messages logged at 00:29:38
00:30:22     INFO -  224 INFO Finished waiting for state change: paused
00:30:22     INFO -  225 INFO Waiting for state change: selected source
00:30:22     INFO -  226 INFO Finished waiting for state change: selected source
00:30:22     INFO -  227 INFO Waiting for state change: loaded source
00:30:22     INFO -  228 INFO Finished waiting for state change: loaded source
00:30:22     INFO -  229 INFO TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | The second element in the scope panel is "<this>" -
00:30:22     INFO -  230 INFO TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | The third element in the scope panel is "phonebook" -
00:30:22     INFO -  231 INFO Expand `phonebook`
00:30:22     INFO -  Buffered messages finished
00:30:22    ERROR -  232 INFO TEST-UNEXPECTED-FAIL | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | Test timed out -
00:30:22     INFO -  233 INFO Removing tab.
00:30:22     INFO -  234 INFO Waiting for event: 'TabClose' on [object XULElement].
00:30:22     INFO -  235 INFO Got event: 'TabClose' on [object XULElement].
00:30:22     INFO -  236 INFO Tab removed and finished closing
00:30:22     INFO -  GECKO(4524) | MEMORY STAT | vsize 901MB | vsizeMaxContiguous 489MB | residentFast 332MB | heapAllocated 116MB

Comment 1

[Intermittent Failures Robot]

43 failures in 660 pushes (0.065 failures/push) were associated with this bug in the last 7 days. 

This is the #31 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 13
* try: 12
* mozilla-inbound: 11
* mozilla-central: 7

Platform breakdown:
* linux32: 14
* windows7-32: 9
* linux64: 9
* linux32-nightly: 4
* linux32-devedition: 4
* windows10-64-devedition: 2
* linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 2

[Stefan Hindli [:stefan_hindli]]

Over the last 6 days this bug has 32 failures. These happen on Windows 7, linux32-nightly, Linux x64, Linux.

Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=178312119&lineNumber=5979

10:53:36     INFO -  147 INFO Finished waiting for state change: paused
10:53:36     INFO -  148 INFO Waiting for state change: selected source
10:53:36     INFO -  149 INFO Finished waiting for state change: selected source
10:53:36     INFO -  150 INFO Waiting for state change: loaded source
10:53:36     INFO -  151 INFO Finished waiting for state change: loaded source
10:53:36     INFO -  152 INFO TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | The second element in the scope panel is "<this>" -
10:53:36     INFO -  153 INFO TEST-PASS | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | The third element in the scope panel is "phonebook" -
10:53:36     INFO -  154 INFO Expand `phonebook`
10:53:36     INFO -  Buffered messages finished
10:53:36    ERROR -  155 INFO TEST-UNEXPECTED-FAIL | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | Test timed out -
10:53:36     INFO -  156 INFO Removing tab.
10:53:36     INFO -  157 INFO Waiting for event: 'TabClose' on [object XULElement].
10:53:36     INFO -  158 INFO Got event: 'TabClose' on [object XULElement].
10:53:36     INFO -  159 INFO Tab removed and finished closing
10:53:36     INFO -  GECKO(3440) | MEMORY STAT | vsize 936MB | vsizeMaxContiguous 442MB | residentFast 346MB | heapAllocated 117MB
10:53:36     INFO -  160 INFO TEST-OK | devtools/client/debugger/new/test/mochitest/browser_dbg-scopes-mutations.js | took 45275ms

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

this test fails in test-verify mode on linux64-opt:
https://taskcluster-artifacts.net/AMLDdXLBSHGi5XBX3bfIPQ/0/public/logs/live_backing.log

Comment 4

[Jason Laster [:jlast]]

thanks, will take a look

Comment 5

[Intermittent Failures Robot]

26 failures in 99 pushes (0.263 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 13
* mozilla-inbound: 9
* try: 2
* mozilla-central: 2

Platform breakdown:
* windows10-64: 10
* linux64: 9
* windows7-32: 5
* linux64-devedition: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-18&endday=2018-05-18&tree=trunk

Comment 6

[Intermittent Failures Robot]

36 failures in 32 pushes (1.125 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 14
* mozilla-central: 10
* mozilla-inbound: 8
* try: 4

Platform breakdown:
* linux64: 15
* windows7-32: 9
* windows10-64: 3
* linux64-nightly: 3
* linux32: 2
* windows7-32-nightly: 1
* osx-10-10: 1
* linux64-ccov: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-19&endday=2018-05-19&tree=trunk

Comment 7

[Intermittent Failures Robot]

134 failures in 639 pushes (0.21 failures/push) were associated with this bug in the last 7 days. 

This is the #9 most frequent failure this week.   

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* autoland: 51
* mozilla-inbound: 37
* try: 25
* mozilla-central: 21

Platform breakdown:
* linux64: 39
* windows7-32: 32
* windows10-64: 25
* linux32: 13
* windows10-64-devedition: 4
* linux64-nightly: 4
* windows7-32-nightly: 3
* windows7-32-devedition: 3
* osx-10-10: 3
* linux64-devedition: 3
* linux32-nightly: 3
* linux64-ccov: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 8

[Andreea Pavel [:apavel]]

:jlast hi, do you have any updates on this?  There are 146 total failures in the last 30 days and the failure rate seems to have increased starting with the 17th of May, 97 failures since then and until today.

Comment 9

[Jason Laster [:jlast]]

yes, I am looking into it now. Sorry for the delay

Comment 10

[Intermittent Failures Robot]

65 failures in 86 pushes (0.756 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 22
* try: 19
* mozilla-inbound: 13
* mozilla-central: 11

Platform breakdown:
* linux64: 26
* linux32: 13
* windows10-64: 9
* windows7-32: 8
* linux64-qr: 2
* windows10-64-nightly: 1
* osx-10-10: 1
* macosx64-nightly: 1
* linux64-nightly: 1
* linux64-jsdcov: 1
* linux64-devedition: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-21&endday=2018-05-21&tree=trunk

Comment 11

[Robert O'Callahan (:roc) (email my personal email if necessary)]

Jason, I don't know if this will help, but we caught this bug in our Pernosco debugger.
https://pernos.co/debug/8YTuQ4odEjAMHQoqhaGwEA/index.html
Access details here: https://mana.mozilla.org/wiki/display/TS/Debugging+with+Pernosco

Comment 12

[Intermittent Failures Robot]

54 failures in 111 pushes (0.486 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 26
* mozilla-inbound: 16
* try: 7
* mozilla-central: 5

Platform breakdown:
* linux64: 17
* windows7-32: 16
* windows10-64: 10
* linux32: 5
* windows10-64-nightly: 1
* macosx64-devedition: 1
* linux64-nightly: 1
* linux64-devedition: 1
* linux64-ccov: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-22&endday=2018-05-22&tree=trunk

Comment 13

[Intermittent Failures Robot]

36 failures in 104 pushes (0.346 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 18
* mozilla-inbound: 13
* mozilla-central: 5

Platform breakdown:
* linux64: 16
* windows7-32: 11
* linux32: 5
* windows10-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-23&endday=2018-05-23&tree=trunk

Comment 14

[Intermittent Failures Robot]

67 failures in 109 pushes (0.615 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 27
* autoland: 26
* try: 7
* mozilla-central: 7

Platform breakdown:
* linux64: 29
* windows7-32: 20
* windows10-64: 8
* linux32: 8
* linux64-qr: 1
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-24&endday=2018-05-24&tree=trunk

Comment 15

[Jason Laster [:jlast]]

I've got a fix locally. 

here's a try run to see if we've got it:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=091b1e39e19695aee0c102a1eba65c389f0a62d2

The summary was changing the test to wait for waitForSelectedSource(dbg, "script-mutate") instead of waitForLoadedSource(dbg, "script-mutate");. The difference is that waitForSelectedSource waits for the source metadata to be set.

Comment 16

[Jason Laster [:jlast]]

this looks like the fix. I'll finish it up soon. and it will go out in the next release

Comment 17

[Intermittent Failures Robot]

51 failures in 143 pushes (0.357 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 16
* mozilla-inbound: 14
* mozilla-central: 14
* try: 7

Platform breakdown:
* linux64: 17
* windows7-32: 14
* windows10-64: 8
* windows10-64-nightly: 3
* linux32: 3
* osx-10-10: 2
* linux64-nightly: 2
* windows7-32-nightly: 1
* windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-25&endday=2018-05-25&tree=trunk

Comment 18

[Andreea Pavel [:apavel]]

(In reply to Jason Laster [:jlast] from comment #16)
> this looks like the fix. I'll finish it up soon. and it will go out in the
> next release

Thanks for looking into this, looking forward for that fix.

Comment 19

[Intermittent Failures Robot]

35 failures in 49 pushes (0.714 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 14
* mozilla-inbound: 10
* try: 6
* mozilla-central: 5

Platform breakdown:
* linux64: 14
* windows7-32: 6
* windows10-64: 6
* linux32: 5
* linux64-nightly: 1
* linux64-jsdcov: 1
* linux64-ccov: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-26&endday=2018-05-26&tree=trunk

Comment 20

[Intermittent Failures Robot]

363 failures in 632 pushes (0.574 failures/push) were associated with this bug in the last 7 days. 

This is the #4 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 136
* mozilla-inbound: 113
* try: 65
* mozilla-central: 49

Platform breakdown:
* linux64: 144
* windows7-32: 92
* windows10-64: 51
* linux32: 38
* linux64-nightly: 8
* windows10-64-nightly: 6
* linux64-jsdcov: 4
* osx-10-10: 3
* linux64-qr: 3
* linux64-ccov: 3
* macosx64-nightly: 2
* linux64-devedition: 2
* linux32-nightly: 2
* windows7-32-nightly: 1
* windows7-32-devedition: 1
* windows10-64-ccov: 1
* macosx64-devedition: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-21&endday=2018-05-27&tree=trunk

Comment 21

[Intermittent Failures Robot]

54 failures in 74 pushes (0.73 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 26
* mozilla-inbound: 14
* mozilla-central: 10
* try: 4

Platform breakdown:
* linux64: 19
* windows7-32: 12
* windows10-64: 8
* linux32: 6
* linux32-nightly: 2
* windows10-64-nightly: 1
* windows10-64-ccov: 1
* osx-10-10: 1
* linux64-nightly: 1
* linux64-jsdcov: 1
* linux64-ccov: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-28&endday=2018-05-28&tree=trunk

Comment 22

[Cosmin Sabou [:CosminS]]

Hi! Any ETA on the fix? This continues to have a big failure rate and a fix would be appreciated. Thanks.

Comment 23

[Jason Laster [:jlast]]

Yes, pushed the fix this morning.

Comment 24

[Intermittent Failures Robot]

51 failures in 139 pushes (0.367 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 30
* mozilla-inbound: 8
* try: 7
* mozilla-central: 6

Platform breakdown:
* windows10-64: 19
* linux64: 17
* windows7-32: 6
* linux32: 4
* osx-10-10: 2
* windows7-32-devedition: 1
* windows10-64-nightly: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-29&endday=2018-05-29&tree=trunk

Comment 25

[Cosmin Sabou [:CosminS]]

Marking this as fixed as per comment #23. There are no failures for 4 days now. Reopen if this reoccurs.

Comment 26

[Intermittent Failures Robot]

122 failures in 655 pushes (0.186 failures/push) were associated with this bug in the last 7 days. 

This is the #6 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 57
* mozilla-inbound: 26
* try: 22
* mozilla-central: 17

Platform breakdown:
* linux64: 41
* windows10-64: 34
* windows7-32: 21
* linux32: 10
* osx-10-10: 3
* linux32-nightly: 3
* windows7-32-devedition: 2
* windows10-64-nightly: 2
* linux64-ccov: 2
* windows10-64-ccov: 1
* linux64-nightly: 1
* linux64-jsdcov: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459789&startday=2018-05-28&endday=2018-06-03&tree=trunk