1379065 - Intermittent test_quit_restart.py TestQuitRestart.test_force_restart | IOError: Process killed because the connection to Marionette server is lost. Check gecko.log for errors (Reason: Timed out waiting for connection on localhost:2828!)

Status: RESOLVED WORKSFORME

(Testing :: Marionette Client and Harness, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: cbook [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=112383372&repo=mozilla-beta

https://queue.taskcluster.net/v1/task/KmSEdg2gTqS-_K98aL8_uw/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is a test failure in headless mode. Not sure if the following warnings are related or if the additional overlapping incoming connection for Marionette is the reason:

1499379986069	Marionette	TRACE	3 <- [1,15,null,{}]
*** You are running in headless mode.
*** You are running in headless mode.

(firefox:2549): GConf-WARNING **: Client failed to connect to the D-BUS daemon:
/usr/bin/dbus-launch terminated abnormally with the following error: Autolaunch error: X11 initialization failed.


(firefox:2549): GConf-WARNING **: Client failed to connect to the D-BUS daemon:
/usr/bin/dbus-launch terminated abnormally with the following error: Autolaunch error: X11 initialization failed.


(firefox:2549): GConf-WARNING **: Client failed to connect to the D-BUS daemon:
/usr/bin/dbus-launch terminated abnormally with the following error: Autolaunch error: X11 initialization failed.

1499380178722	Marionette	INFO	Listening on port 2828
1499380178812	Marionette	DEBUG	Accepted connection 0 from 127.0.0.1:49020
1499380178849	Marionette	DEBUG	Accepted connection 1 from 127.0.0.1:49021
1499380178852	Marionette	DEBUG	Closed connection 0
1499380178857	Marionette	TRACE	1 -> [0,1,"newSession",{"sessionId":null,"capabilities":null}]
1499380178867	Marionette	CONFIG	Matched capabilities: {"browserName":"firefox","browserVersion":"55.0","platformName":"linux","platformVersion":"3.13.0-112-generic","pageLoadStrategy":"normal","acceptInsecureCerts":false,"timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"rotatable":false,"specificationLevel":0,"moz:processID":2549,"moz:profile":"/tmp/tmpEbbfn5.mozrunner","moz:accessibilityChecks":false}
JavaScript error: chrome://marionette/content/server.js, line 337: NS_ERROR_SOCKET_ADDRESS_IN_USE: Component returned failure code: 0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE) [nsIServerSocket.initSpecialConnection]

Brendan, any idea regarding the dbus warnings?

Comment 2

[Intermittent Failures Robot]

1 failures in 656 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1379065&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 3

[Brendan Dahl [:bdahl]]

I've seen the dbus warnings happen locally and they don't seem to be an issue since they are from some telemetry calls (see bug 1368211). This test failure looks like the previous run of firefox didn't fully shutdown and close all its connections. Given the very low failure rate, I think we need to wait and see if this is actually a headless issue or a general shutdown issue.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

We had bug 1374043 which was fixed recently and which caused a slow down issue when shutting down Firefox as reported on several bugs in the depencency list. Maybe that's somewhat related. Lets see.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Whereby this crash is beta only so far...

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+2]]

With more logging in Marionette we have more information here:

02:52:18     INFO -  *** You are running in headless mode.
02:52:18     INFO -  1500432738433	Marionette	DEBUG	Received observer notification "profile-after-change"
02:52:18     INFO -  1500432738481	Marionette	DEBUG	Received observer notification "command-line-startup"
02:52:18     INFO -  1500432738481	Marionette	INFO	Enabled via --marionette
02:55:24    ERROR -  TEST-UNEXPECTED-ERROR | test_quit_restart.py TestQuitRestart.test_force_restart | IOError: Process killed because the connection to Marionette server is lost. Check gecko.log for errors (Reason: Timed out waiting for connection on localhost:2828!)

So there is no notification for 'sessionstore-windows-restored' within 3 minutes, which we need to initialize Marionette.

I will file a new bug to specifically handle that.

Comment 7

[Intermittent Failures Robot]

2 failures in 822 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1379065&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 1008 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1379065&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1379065&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 10

[Andreea Pavel [:apavel]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=163143487&repo=autoland&lineNumber=32320

Comment 11

[Intermittent Failures Robot]

1 failures in 675 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1379065&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 12

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 13

[Intermittent Failures Robot]

1 failures in 669 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1379065&startday=2018-06-04&endday=2018-06-10&tree=trunk

Comment 14

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This seems to be finally working now.

Comment 16

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.