1535459 - Perma tier2- devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js | Test timed out -

Status: RESOLVED FIXED

(Core Graveyard :: Web Replay, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=233960604&repo=autoland

https://queue.taskcluster.net/v1/task/Q7N0aCofRuqWJf9S0uvq0g/runs/0/artifacts/public/logs/live_backing.log

20:15:00 INFO - TEST-START | devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js
20:15:00 INFO - GECKO(801) | MIDDLEMAN 809 /var/folders/1n/fgw1wrbj2b5647p5_8cp11k000000w/T/TempRecording.801.1
20:15:00 INFO - GECKO(801) | RECORDING 810 /var/folders/1n/fgw1wrbj2b5647p5_8cp11k000000w/T/TempRecording.801.1
20:15:02 INFO - GECKO(801) | Exiting due to channel error.
20:15:02 INFO - GECKO(801) | ###!!! [Parent][MessageChannel] Error: (msgtype=0x1F0088,name=PBrowser::Msg_Destroy) Channel error: cannot send/recv
20:15:15 INFO - GECKO(801) | 2019-03-14 20:15:15.278 firefox[801:3823] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)
20:15:45 INFO - TEST-INFO | started process screencapture
20:15:46 INFO - TEST-INFO | screencapture: exit 0
20:15:46 INFO - Buffered messages logged at 20:15:00
20:15:46 INFO - Entering test bound
20:15:46 INFO - Waiting for event: 'RecordingFinished' on [object ParentProcessMessageManager].
20:15:46 INFO - Buffered messages logged at 20:15:02
20:15:46 INFO - Console message: [JavaScript Error: "remote browser crashed while on about:blank
20:15:46 INFO - " {file: "chrome://mochikit/content/mochitest-e10s-utils.js" line: 8}]
20:15:46 INFO - e10s_init/<@chrome://mochikit/content/mochitest-e10s-utils.js:8:8
20:15:46 INFO - EventListener.handleEvent*e10s_init@chrome://mochikit/content/mochitest-e10s-utils.js:6:10
20:15:46 INFO - testInit@chrome://mochikit/content/browser-test.js:103:5
20:15:46 INFO - setTimeout handler*@chrome://mochikit/content/browser-test.js:21:1
20:15:46 INFO - loadChromeScripts@jar:file:///var/folders/1n/fgw1wrbj2b5647p5_8cp11k000000w/T/tmpnluLBP.mozrunner/extensions/[e-mail]!/api.js:13:25
20:15:46 INFO - loadMochitest@jar:file:///var/folders/1n/fgw1wrbj2b5647p5_8cp11k000000w/T/tmpnluLBP.mozrunner/extensions/[e-mail]!/api.js:112:3
20:15:46 INFO - @tests/mochitest/runtests.py:1772:5
20:15:46 INFO - @tests/mochitest/runtests.py:1773:8
20:15:46 INFO - evaluate.sandbox/promise<@chrome://marionette/content/evaluate.js:128:10
20:15:46 INFO - evaluate.sandbox@chrome://marionette/content/evaluate.js:106:17
20:15:46 INFO - GeckoDriver.prototype.execute_@chrome://marionette/content/driver.js:1029:28
20:15:46 INFO - async*GeckoDriver.prototype.executeScript@chrome://marionette/content/driver.js:911:29
20:15:46 INFO - despatch@chrome://marionette/content/server.js:289:40
20:15:46 INFO - execute@chrome://marionette/content/server.js:262:16
20:15:46 INFO - onPacket/<@chrome://marionette/content/server.js:235:20
20:15:46 INFO - onPacket@chrome://marionette/content/server.js:236:9
20:15:46 INFO - _onJSONObjectReady/<@chrome://marionette/content/transport.js:492:20
20:15:46 INFO -
20:15:46 INFO - Buffered messages finished
20:15:46 INFO - TEST-UNEXPECTED-FAIL | devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js | Test timed out -
20:15:46 INFO - Removing tab.
20:15:46 INFO - Waiting for event: 'TabClose' on [object XULElement].
20:15:46 INFO - Got event: 'TabClose' on [object XULElement].
20:15:46 INFO - Tab removed and finished closing
20:15:46 INFO - GECKO(801) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
20:15:46 INFO - GECKO(801) | MEMORY STAT | vsize 4401MB | residentFast 322MB | heapAllocated 102MB

Comment 1

[Noemi Erli[:noemi_erli]]

This turned perma since Bug 1535367 landed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedJob=233960604&revision=f72d9c9dbcf08cef5872047a16f8c5a0c4876840

:mossop Can you please take a look at this?

Comment 2

[Andrew McCreight [:mccr8]]

Brian is looking after the web replay tests.

Comment 3

[Jason Laster [:jlast]]

looks like webreplay fails to start as well. So the repro should be fairly simple
https://crash-stats.mozilla.org/report/index/3afcb441-92d1-4601-a03a-64d180190315

Comment 4

[Dave Townsend [:mossop]]

I'd be a little surprised if bug 1535367 caused this, but give me a shout if you need help.

Comment 5

[Brian Hackett [Laid off!]]

Attachment: Bug 1535459 - Create BrowsingContext in middleman processes, r=nika.

Comment 6

[Intermittent Failures Robot]

42 failures in 436 pushes (0.096 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 10
• mozilla-inbound: 9
• try: 3

Platform breakdown:

• osx-10-10: 39
• macosx64-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-03-15&endday=2019-03-15&tree=all

Comment 7

[Intermittent Failures Robot]

21 failures in 167 pushes (0.126 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-inbound: 6
• mozilla-central: 4

Platform breakdown:

• osx-10-10: 19
• macosx64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-03-16&endday=2019-03-16&tree=all

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b64e2db59556
Create BrowsingContext in middleman processes.

Comment 9

[Brian Hackett [Laid off!]]

I pushed this to unbreak things while waiting for review.

Comment 10

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/b64e2db59556

Comment 11

[Intermittent Failures Robot]

84 failures in 2771 pushes (0.03 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 43
• mozilla-central: 18
• mozilla-inbound: 20
• try: 3

Platform breakdown:

• osx-10-10: 78
• macosx64-nightly: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 13

[Pascal Chevrel:pascalc]

Brian, this bug is marked as fixed for 67 but the crash for the signatures that corresponds to bug 1535614 that you marked as a duplicate of this bug didn't go down. Can you investigate please? Thanks

Comment 14

[Brian Hackett [Laid off!]]

(In reply to Pascal Chevrel:pascalc from comment #13)

Brian, this bug is marked as fixed for 67 but the crash for the signatures that corresponds to bug 1535614 that you marked as a duplicate of this bug didn't go down. Can you investigate please? Thanks

Hi, the crash in bug 1535614 is one where web replay is enabled, which is an experimental/unsupported configuration. There can be other crashes in nsWebBrowser::Create, but these will have a different underlying cause from this bug and the crash in bug 1535614.

Comment 15

[Cristina Coroiu [:ccoroiu]]

Retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=os%2Cx%2C10.10%2Cshippable%2Copt%2Cmochitests%2Ctest-macosx64-shippable%2Fopt-mochitest-devtools-webreplay-e10s%2Cm%28dt-wr%29&tochange=62ee0aed9e59a3b157b04a19177c4039d1d494e6&fromchange=4b056b3a6e755fdaa8a0f30fde0876261c3021db&selectedJob=241470001

The culprit is: https://bugzilla.mozilla.org/show_bug.cgi?id=1493225

Jim, can you please take a look?

Comment 16

[Brian Hackett [Laid off!]]

I can take care of fixing the web replay test failures after bug 1493225 relands.

Comment 17

[Intermittent Failures Robot]

46 failures in 354 pushes (0.13 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 46

Platform breakdown:

• osx-10-10-shippable: 46

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-04-19&endday=2019-04-19&tree=all

Comment 18

[Intermittent Failures Robot]

46 failures in 2673 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #49 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 46

Platform breakdown:

• osx-10-10-shippable: 46

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 19

[Jim Porter (:squib)]

I also took a brief look at this locally, but the test in question fails both with and without the patch for me on Linux (I don't have a macOS machine to test on, unfortunately). Once I reland the patches (probably Monday so no one has to spend time on the weekend to back it out again if there's a problem :)), I'm happy to help out if there's anything I can do to make sure this bug isn't a problem.

Comment 20

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 21

[Stefan Hindli [:stefan_hindli]]

New failure: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&selectedJob=247699547

Comment 22

[Intermittent Failures Robot]

34 failures in 801 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-inbound: 8
• mozilla-central: 5

Platform breakdown:

• macosx1010-64-shippable: 34

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-22&endday=2019-05-22&tree=all

Comment 23

[Andreea Pavel [:apavel]]

More details https://bugzilla.mozilla.org/show_bug.cgi?id=1483350#c17

Comment 24

[Intermittent Failures Robot]

36 failures in 808 pushes (0.045 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 22
• mozilla-inbound: 8
• mozilla-central: 6

Platform breakdown:

• macosx1010-64-shippable: 36

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-23&endday=2019-05-23&tree=all

Comment 25

[Intermittent Failures Robot]

38 failures in 899 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 22
• mozilla-inbound: 11
• mozilla-central: 4
• try: 1

Platform breakdown:

• macosx1010-64-shippable: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-24&endday=2019-05-24&tree=all

Comment 26

[Intermittent Failures Robot]

17 failures in 246 pushes (0.069 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 2
• mozilla-inbound: 2

Platform breakdown:

• macosx1010-64-shippable: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-25&endday=2019-05-25&tree=all

Comment 27

[Andreea Pavel [:apavel]]

Brian can you take a look at this too? the fix in bug 1483350 did not work for this as well.

There are 137 total failures in the last 6 days all on macosx1010-64-shippable opt.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=248399078&repo=autoland&lineNumber=954

07:29:40 INFO - TEST-START | devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js
07:29:40 INFO - GECKO(1978) | MIDDLEMAN 1987 /var/folders/q2/t9n14kms3l9b5hjvfhnkjb_w00000x/T/TempRecording.1978.1
07:29:40 INFO - GECKO(1978) | RECORDING 1988 /var/folders/q2/t9n14kms3l9b5hjvfhnkjb_w00000x/T/TempRecording.1978.1
07:29:41 INFO - GECKO(1978) | Exiting due to channel error.
07:29:54 INFO - GECKO(1978) | 2019-05-26 07:29:54.871 firefox[1978:17174] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)
07:29:57 INFO - GECKO(1978) | console.info: services.settings: Initialize Remote Settings
07:30:25 INFO - TEST-INFO | started process screencapture
07:30:25 INFO - TEST-INFO | screencapture: exit 0
07:30:25 INFO - Buffered messages logged at 07:29:40
07:30:25 INFO - Entering test bound
07:30:25 INFO - Waiting for event: 'RecordingFinished' on [object ParentProcessMessageManager].
07:30:25 INFO - Buffered messages logged at 07:29:41
07:30:25 INFO - Console message: [JavaScript Error: "remote browser crashed while on about:blank
07:30:25 INFO - " {file: "chrome://mochikit/content/mochitest-e10s-utils.js" line: 8}]
07:30:25 INFO - e10s_init/<@chrome://mochikit/content/mochitest-e10s-utils.js:8:8
07:30:25 INFO - EventListener.handleEvente10s_init@chrome://mochikit/content/mochitest-e10s-utils.js:6:10
07:30:25 INFO - testInit@chrome://mochikit/content/browser-test.js:105:5
07:30:25 INFO - setTimeout handler@chrome://mochikit/content/browser-test.js:23:1
07:30:25 INFO - loadChromeScripts@jar:file:///var/folders/q2/t9n14kms3l9b5hjvfhnkjb_w00000x/T/tmpsLfrnG.mozrunner/extensions/[e-mail]!/api.js:13:25
07:30:25 INFO - loadMochitest@jar:file:///var/folders/q2/t9n14kms3l9b5hjvfhnkjb_w00000x/T/tmpsLfrnG.mozrunner/extensions/[e-mail]!/api.js:112:3
07:30:25 INFO - @tests/mochitest/runtests.py:1783:5
07:30:25 INFO - @tests/mochitest/runtests.py:1784:8
07:30:25 INFO - evaluate.sandbox/promise<@chrome://marionette/content/evaluate.js:128:10
07:30:25 INFO - evaluate.sandbox@chrome://marionette/content/evaluate.js:106:17
07:30:25 INFO - GeckoDriver.prototype.execute_@chrome://marionette/content/driver.js:1029:28
07:30:25 INFO - async*GeckoDriver.prototype.executeScript@chrome://marionette/content/driver.js:911:29
07:30:25 INFO - despatch@chrome://marionette/content/server.js:289:40
07:30:25 INFO - execute@chrome://marionette/content/server.js:262:16
07:30:25 INFO - onPacket/<@chrome://marionette/content/server.js:235:20
07:30:25 INFO - onPacket@chrome://marionette/content/server.js:236:9
07:30:25 INFO - _onJSONObjectReady/<@chrome://marionette/content/transport.js:492:20
07:30:25 INFO -
07:30:25 INFO - Buffered messages finished
07:30:25 INFO - TEST-UNEXPECTED-FAIL | devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js | Test timed out -
07:30:25 INFO - Removing tab.
07:30:25 INFO - Waiting for event: 'TabClose' on [object XULElement].
07:30:25 INFO - Got event: 'TabClose' on [object XULElement].
07:30:25 INFO - Tab removed and finished closing
07:30:25 INFO - GECKO(1978) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
07:30:25 INFO - GECKO(1978) | MEMORY STAT | vsize 5423MB | residentFast 313MB | heapAllocated 100MB
07:30:25 INFO - TEST-OK | devtools/client/webreplay/mochitest/browser_dbg_rr_breakpoints-01.js | took 45234ms

Comment 28

[Brian Hackett [Laid off!]]

Attachment: Bug 1535459 - Make sure ContentChild is connected in middleman processes, r=mccr8.

Comment 29

[Intermittent Failures Robot]

159 failures in 4730 pushes (0.034 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 94
• mozilla-central: 23
• mozilla-inbound: 34
• try: 8

Platform breakdown:

• macosx1010-64-shippable: 157
• macosx1010-64: 1
• macosx1010-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 30

[Intermittent Failures Robot]

29 failures in 632 pushes (0.046 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-inbound: 6
• mozilla-central: 3
• try: 1

Platform breakdown:

• macosx1010-64-shippable: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-27&endday=2019-05-27&tree=all

Comment 31

[Brian Hackett [Laid off!]]

Web replay was broken by some recent IPC changes, which the above patch fixes. Since this started when bug 1483350 was causing the web replay tests to fail anyways on treeherder, I'm not sure exactly which change regressed this.

Comment 32

[Intermittent Failures Robot]

41 failures in 841 pushes (0.049 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 23
• mozilla-central: 6
• mozilla-inbound: 7
• try: 5

Platform breakdown:

• macosx1010-64-shippable: 41

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-28&endday=2019-05-28&tree=all

Comment 33

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a2bc45cc8cac
Make sure ContentChild is connected in middleman processes, r=mccr8.

Comment 34

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/a2bc45cc8cac

Comment 35

[BugBot [:suhaib / :marco/ :calixte]]

Since the status are different for nightly and release, what's the status for beta?
For more information, please visit auto_nag documentation.

Comment 36

[Jason Laster [:jlast]]

this is not needed on beta

Comment 37

[Intermittent Failures Robot]

17 failures in 917 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-inbound: 2
• mozilla-central: 4

Platform breakdown:

• macosx1010-64-shippable: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-29&endday=2019-05-29&tree=all

Comment 38

[Intermittent Failures Robot]

87 failures in 4337 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 53
• mozilla-inbound: 15
• mozilla-central: 13
• try: 6

Platform breakdown:

• macosx1010-64-shippable: 87

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1535459&startday=2019-06-03&endday=2019-06-09&tree=all