1414144 - Intermittent TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/cookies/delete_cookie.py | expected OK

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=141863336&repo=autoland

https://queue.taskcluster.net/v1/task/Wes-UC5ORHCN5ufNmAK-7g/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Here an excerpt from the failure:

[task 2017-11-03T03:25:42.976Z] 03:25:42     INFO - PID 1453 | 1509679542967	Marionette	DEBUG	Received DOM event "DOMContentLoaded" for "about:neterror?e=dnsNotFound&u=http%3A//web-platform.test%3A8000/webdriver/tests/support/inline.py%3Fdoc%3D%253Ctitle%253EWD+doc+title%253C%252Ftitle%253E%26content-type%3Dtext%252Fhtml%253Bcharset%253Dutf-8&c=UTF-8&f=regular&d=Firefox%20can%E2%80%99t%20find%20the%20server%20at%20web-platform.test."
[task 2017-11-03T03:25:43.919Z] 03:25:43     INFO - STDOUT: FAILED
[task 2017-11-03T03:25:44.061Z] 03:25:44     INFO - PID 1453 | 1509679544051	Marionette	INFO	New connections will no longer be accepted
[task 2017-11-03T03:25:44.279Z] 03:25:44     INFO - PID 1453 | [Child 1673] WARNING: pipe error (17): Connection reset by peer: file /build/firefox-l1g98U/firefox-56.0+build6/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 353
[task 2017-11-03T03:25:44.280Z] 03:25:44     INFO - PID 1453 | [Child 1673] WARNING: pipe error (3): Connection reset by peer: file /build/firefox-l1g98U/firefox-56.0+build6/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 353
[task 2017-11-03T03:25:44.337Z] 03:25:44     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_missing_value 

As it looks like we hit a network issue here, and as result the requested page could not be loaded. I don't know how DNS is handled by wptrunner and wptserve, so I would like to defer to James here.

Otherwise why do the pipe errors contain "/build/firefox-l1g98U/firefox-56.0+build6/" for a build on autoland which is Firefox 58?

For me the above sounds like a operating system failure, maybe a complete network stack shutdown?

Comment 2

[James Graham [:jgraham]]

I suspect that's a symptom rather than the cause. I would guess that the test is failing in some way, we close the connection and then try to communicate over it for some reason. I think you'd need to find a way to reproduce the failure to see exactly what's happening though.

Comment 3

[Intermittent Failures Robot]

1 failures in 857 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 4

[(not currently active) Ted Mielczarek]

I don't have any specific knowledge here, and I don't have time to dig into this. Sorry.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to Henrik Skupin (:whimboo) from comment #1)
> [task 2017-11-03T03:25:44.279Z] 03:25:44     INFO - PID 1453 | [Child 1673]
> WARNING: pipe error (17): Connection reset by peer: file
> /build/firefox-l1g98U/firefox-56.0+build6/ipc/chromium/src/chrome/common/
> ipc_channel_posix.cc, line 353
>
> Otherwise why do the pipe errors contain
> "/build/firefox-l1g98U/firefox-56.0+build6/" for a build on autoland which
> is Firefox 58?

Kan-Ru, do you have an explanation for the above question? Why do we show 56.0 for a current build from autoland?

Comment 6

[Intermittent Failures Robot]

1 failures in 849 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 7

[Kan-Ru Chen [:kanru] (UTC+9)]

(In reply to Henrik Skupin (:whimboo) from comment #5)
> (In reply to Henrik Skupin (:whimboo) from comment #1)
> > [task 2017-11-03T03:25:44.279Z] 03:25:44     INFO - PID 1453 | [Child 1673]
> > WARNING: pipe error (17): Connection reset by peer: file
> > /build/firefox-l1g98U/firefox-56.0+build6/ipc/chromium/src/chrome/common/
> > ipc_channel_posix.cc, line 353
> >
> > Otherwise why do the pipe errors contain
> > "/build/firefox-l1g98U/firefox-56.0+build6/" for a build on autoland which
> > is Firefox 58?
> 
> Kan-Ru, do you have an explanation for the above question? Why do we show
> 56.0 for a current build from autoland?

I have no idea tbh. The only explanation I can think of is that maybe the test runner is using an older version of firefox to run something.

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Hm, the build has been downloaded from:
https://tools.taskcluster.net/groups/Lk2knvElS4KwOENmItI0Tw/tasks/J704BOBjRJ-Rho7TJmICcQ/runs/0/artifacts

Which is:

20171103021641
https://hg.mozilla.org/integration/autoland/rev/e6d86b7284bae701700b9d300ee1476ebe5f3eed

So it's nothing related to 56 beta at all.

AFAIK we always create a new docker instance for each job on Linux, so there shouldn't be any remaining Firefox process running.

Comment 9

[Intermittent Failures Robot]

1 failures in 744 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 10

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This still happens:
https://treeherder.mozilla.org/logviewer.html#?job_id=155191260&repo=autoland&lineNumber=1983

The test exceeds the 25s default timeout because there seem to be a hang in `test_handle_prompt_accept` or during shutdown. Due to less logging output this is hard to say:

[task 2018-01-10T01:00:13.888Z] 01:00:13     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_accept 
[task 2018-01-10T01:00:43.571Z] 01:00:43     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/cookies/delete_cookie.py | expected OK
[task 2018-01-10T01:00:43.571Z] 01:00:43     INFO - TEST-INFO took 30002ms

Comment 12

[Intermittent Failures Robot]

18 failures in 788 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 8
* mozilla-inbound: 5
* try: 2
* mozilla-beta: 2
* mozilla-central: 1

Platform breakdown:
* linux64: 9
* linux32: 6
* linux64-nightly: 1
* linux64-devedition: 1
* linux32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-01-08&endday=2018-01-14&tree=all

Comment 13

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Debug builds show the following here:

[task 2018-01-10T03:21:31.525Z] 03:21:31     INFO - PID 2965 | [Parent 2977, IPDL Background] WARNING: Some storage operations are taking longer than expected during shutdown and will be aborted!: file /builds/worker/workspace/build/src/dom/quota/ActorsParent.cpp, line 5824
[task 2018-01-10T03:21:46.397Z] 03:21:46     INFO - PID 2965 | *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping
[task 2018-01-10T03:21:50.327Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:21:50.327Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:21:50.328Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:21:50.329Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:21:50.330Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:21:50.330Z] 03:21:50     INFO - PID 2965 | [Parent 2977, Main Thread] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/dom/xhr/XMLHttpRequestMainThread.cpp, line 2772
[task 2018-01-10T03:22:03.712Z] 03:22:03     INFO - PID 2965 | Hit MOZ_CRASH(Workers Hanging - A:3|S:0|Q:0-BC:0|WorkerHolderToken-BC:0|WorkerHolderToken-BC:0|WorkerHolderToken) at /builds/worker/workspace/build/src/dom/workers/RuntimeService.cpp:2187
[task 2018-01-10T03:22:03.712Z] 03:22:03     INFO - PID 2965 | ExceptionHandler::GenerateDump cloned child 3127
[task 2018-01-10T03:22:03.713Z] 03:22:03     INFO - PID 2965 | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2018-01-10T03:22:03.714Z] 03:22:03     INFO - PID 2965 | ExceptionHandler::WaitForContinueSignal waiting for continue signal...

So it also looks like that we are having a hang during shutdown caused by workers. Andrea, I assume that this might also be related to bug 1425559?

Comment 14

[Intermittent Failures Robot]

27 failures in 657 pushes (0.041 failures/push) were associated with this bug in the last 7 days. 

This is the #39 most frequent failure this week.   

Repository breakdown:
* autoland: 17
* mozilla-inbound: 8
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 18
* linux32: 8
* linux32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-01-15&endday=2018-01-21&tree=all

Comment 15

[Intermittent Failures Robot]

33 failures in 701 pushes (0.047 failures/push) were associated with this bug in the last 7 days. 

This is the #34 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 16
* try: 8
* mozilla-inbound: 6
* mozilla-central: 2
* mozilla-beta: 1

Platform breakdown:
* linux64: 13
* linux32: 13
* windows7-32-stylo-disabled: 2
* linux32-nightly: 2
* windows10-64: 1
* linux64-ccov: 1
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 16

[Arthur Iakab [arthur_iakab]]

This bug has failed 34 times in the last 7 days on Linux affecting pgo build types.
Failing test: opt-web-platform-tests-wdspec-e10

Link to a recent log: https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=160000339&lineNumber=1868

Part of that log:
[task 2018-02-02T01:44:12.084Z] 01:44:12     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_accept 
[task 2018-02-02T01:44:12.269Z] 01:44:12     INFO - PID 2836 | [Parent 2848, Gecko_IOThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 709
[task 2018-02-02T01:44:41.768Z] 01:44:41     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/cookies/delete_cookie.py | expected OK
[task 2018-02-02T01:44:41.769Z] 01:44:41     INFO - TEST-INFO took 30001ms
[task 2018-02-02T01:44:41.799Z] 01:44:41  WARNING - u'runner_teardown': ()
[task 2018-02-02T01:44:41.800Z] 01:44:41     INFO - Starting runner
[task 2018-02-02T01:44:41.823Z] 01:44:41     INFO - PID 2992 | 1517535881815	geckodriver	INFO	geckodriver 0.19.1 ( '0690bf69410a'  '2018-02-01 12:29 -0800')
[task 2018-02-02T01:44:41.823Z] 01:44:41     INFO - PID 2992 | 1517535881818	geckodriver	INFO	Listening on 127.0.0.1:4447
[task 2018-02-02T01:44:42.322Z] 01:44:42     INFO - WebDriver HTTP server listening at http://127.0.0.1:4447/
[task 2018-02-02T01:44:42.323Z] 01:44:42     INFO - TEST-START | /webdriver/tests/cookies/get_named_cookie.py
[task 2018-02-02T01:44:42.500Z] 01:44:42     INFO - STDOUT: ============================= test session starts ==============================
[task 2018-02-02T01:44:42.501Z] 01:44:42     INFO - STDOUT: platform linux2 -- Python 2.7.12, pytest-unknown, py-1.5.2, pluggy-0.5.3.dev -- /builds/worker/workspace/build/venv/bin/python
[task 2018-02-02T01:44:42.502Z] 01:44:42     INFO - STDOUT: rootdir: /builds/worker/workspace/build, inifile:
[task 2018-02-02T01:44:42.502Z] 01:44:42     INFO - STDOUT: collecting ... 
[task 2018-02-02T01:44:42.538Z] 01:44:42     INFO - STDOUT: collected 3 items

:whimboo do you have any update on this?

Comment 17

[Intermittent Failures Robot]

30 failures in 735 pushes (0.041 failures/push) were associated with this bug in the last 7 days. 

This is the #33 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 12
* autoland: 10
* mozilla-central: 6
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 18
* linux32: 10
* linux64-nightly: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-01-29&endday=2018-02-04&tree=all

Comment 18

[Andrea Marchesini [:baku]]

Can you check if this is fixed after bug 1422036?

Comment 19

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The intermittent failure is still present also with the backout of the patch from bug 1434618 which caused way more issues.

https://treeherder.mozilla.org/logviewer.html#?job_id=160525168&repo=mozilla-inbound&lineNumber=2005

[task 2018-02-06T01:44:05.900Z] 01:44:05     INFO - TEST-START | /webdriver/tests/cookies/delete_cookie.py
[task 2018-02-06T01:44:05.907Z] 01:44:05     INFO - STDOUT: ============================= test session starts ==============================
[task 2018-02-06T01:44:05.909Z] 01:44:05     INFO - STDOUT: platform linux2 -- Python 2.7.12, pytest-unknown, py-1.5.2, pluggy-0.5.3.dev -- /builds/worker/workspace/build/venv/bin/python
[task 2018-02-06T01:44:05.909Z] 01:44:05     INFO - STDOUT: rootdir: /builds/worker/workspace/build, inifile:
[task 2018-02-06T01:44:05.910Z] 01:44:05     INFO - STDOUT: collecting ... 
[task 2018-02-06T01:44:05.926Z] 01:44:05     INFO - STDOUT: collected 7 items
[task 2018-02-06T01:44:05.927Z] 01:44:05     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_no_browsing_context 
[task 2018-02-06T01:44:06.048Z] 01:44:06     INFO - STDOUT: PASSED
[task 2018-02-06T01:44:06.191Z] 01:44:06     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_dismiss_and_notify 
[task 2018-02-06T01:44:06.193Z] 01:44:06     INFO - STDOUT: PASSED
[task 2018-02-06T01:44:06.193Z] 01:44:06     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_accept_and_notify 
[task 2018-02-06T01:44:06.194Z] 01:44:06     INFO - STDOUT: PASSED
[task 2018-02-06T01:44:06.198Z] 01:44:06     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_ignore 
[task 2018-02-06T01:44:06.199Z] 01:44:06     INFO - STDOUT: PASSED
[task 2018-02-06T01:44:06.199Z] 01:44:06     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/cookies/delete_cookie.py::test_handle_prompt_accept 
[task 2018-02-06T01:44:35.862Z] 01:44:35     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/cookies/delete_cookie.py | expected OK

All the tests work fine, but then we hang during shutdown of Firefox in test_handle_prompt_accept. Maybe it's somewhat related to bug 1425559? Sadly those are all opt builds where it happens so not that much logging is available.

Comment 20

[Intermittent Failures Robot]

28 failures in 702 pushes (0.04 failures/push) were associated with this bug in the last 7 days. 

This is the #44 most frequent failure this week.   

Repository breakdown:
* autoland: 13
* mozilla-inbound: 6
* mozilla-central: 4
* mozilla-beta: 4
* try: 1

Platform breakdown:
* linux64: 13
* linux32: 12
* linux64-nightly: 1
* linux64-devedition: 1
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-02-05&endday=2018-02-11&tree=all

Comment 21

[Intermittent Failures Robot]

16 failures in 685 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 7
* mozilla-inbound: 5
* mozilla-central: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 7
* linux32: 6
* linux32-nightly: 2
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-02-12&endday=2018-02-18&tree=all

Comment 22

[Intermittent Failures Robot]

20 failures in 675 pushes (0.03 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 7
* mozilla-inbound: 5
* try: 4
* mozilla-central: 3
* mozilla-beta: 1

Platform breakdown:
* linux64: 13
* linux32: 5
* linux64-devedition: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 23

[Cristina Coroiu [:ccoroiu]]

In the last 7 days, there have been 31 failures.

The failures are on Linux x64 and Linux platform and it affects opt and pgo build types.

Recent log file:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=165410711&lineNumber=2000

:whimboo, :baku Do you have any updates here?

Comment 24

[Intermittent Failures Robot]

34 failures in 831 pushes (0.041 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 24
* mozilla-inbound: 4
* mozilla-central: 3
* mozilla-beta: 2
* try: 1

Platform breakdown:
* linux64: 16
* linux32: 15
* linux32-devedition: 2
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-02-26&endday=2018-03-04&tree=all

Comment 25

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is clearly a shutdown hang:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=166463179&lineNumber=17056

Andrea, do you think it could improve when we move to `will-xpcom-shutdown`? Sadly this hang only happens for opt/pgo builds, so no further information available.

Comment 26

[Andreas Tolfsen ❲:ato❳]

FWIW I moved Marionette to use xpcom-will-shutdown in
https://bugzil.la/1428795, so if we think that will have an impact
here we should see a decline in the OF score pretty soon.

Comment 27

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Oh, Andreas filed bug 1443524 which this should be dependent on.

Comment 28

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to Andreas Tolfsen ‹:ato› from comment #26)
> FWIW I moved Marionette to use xpcom-will-shutdown in
> https://bugzil.la/1428795, so if we think that will have an impact
> here we should see a decline in the OF score pretty soon.

No, I was talking about bug 1434618.

Comment 29

[Intermittent Failures Robot]

18 failures in 747 pushes (0.024 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 7
* autoland: 7
* mozilla-central: 3
* try: 1

Platform breakdown:
* linux32: 11
* linux64: 6
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-03-05&endday=2018-03-11&tree=all

Comment 30

[Intermittent Failures Robot]

13 failures in 814 pushes (0.016 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* mozilla-central: 3
* try: 2
* mozilla-inbound: 2
* mozilla-release: 1

Platform breakdown:
* linux64: 6
* linux32: 5
* linux64-nightly: 1
* linux32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414144&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 31

[Intermittent Failures Robot]

27 failures in 822 pushes (0.033 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 14
* mozilla-inbound: 7
* mozilla-central: 5
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 11
* linux64: 8
* linux32: 6
* linux64-nightly: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-03-20&endday=2018-03-26&tree=trunk

Comment 32

[Henrik Skupin [:whimboo][⌚️UTC+2]]

In most cases when this failures is happening the hang occurs in `test_handle_prompt_accept`, which is using a new session. So this failure should depend on a solution for bug 1449538.

But there are also a low number of cases when Firefox restarts quickly but then no "sessionstore-windows-restored" notification is received by Marionette:

https://treeherder.mozilla.org/logviewer.html#?job_id=170140630&repo=mozilla-inbound&lineNumber=20448-20464

This should basically be bug 1382162.

Comment 33

[Intermittent Failures Robot]

44 failures in 718 pushes (0.061 failures/push) were associated with this bug in the last 7 days. 

This is the #31 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 22
* mozilla-inbound: 13
* mozilla-central: 7
* try: 2

Platform breakdown:
* linux64-qr: 21
* linux64: 11
* linux32: 10
* linux32-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-03-26&endday=2018-04-01&tree=trunk

Comment 34

[Intermittent Failures Robot]

29 failures in 765 pushes (0.038 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 15
* mozilla-inbound: 6
* try: 4
* mozilla-central: 4

Platform breakdown:
* linux64: 10
* linux64-qr: 9
* linux32: 9
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-04-02&endday=2018-04-08&tree=trunk

Comment 35

[Intermittent Failures Robot]

18 failures in 792 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 7
* mozilla-inbound: 5
* mozilla-beta: 3
* mozilla-central: 2
* try: 1

Platform breakdown:
* linux64: 7
* linux32: 6
* linux32-devedition: 2
* linux64-qr: 1
* linux64-nightly: 1
* linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-04-09&endday=2018-04-15&tree=trunk

Comment 36

[Intermittent Failures Robot]

18 failures in 782 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 7
* autoland: 5
* mozilla-beta: 3
* try: 2
* mozilla-central: 1

Platform breakdown:
* linux32: 7
* linux64: 6
* linux64-nightly: 3
* linux64-qr: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-04-16&endday=2018-04-22&tree=trunk

Comment 37

[Intermittent Failures Robot]

11 failures in 780 pushes (0.014 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 7
* try: 1
* mozilla-inbound: 1
* mozilla-esr60: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 4
* linux64: 3
* linux32: 3
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-04-23&endday=2018-04-29&tree=trunk

Comment 38

[Intermittent Failures Robot]

1 failures in 551 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-04-30&endday=2018-05-06&tree=trunk

Comment 39

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Fixed by bug 1449538.

Comment 40

[Intermittent Failures Robot]

2 failures in 632 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr60: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-05-21&endday=2018-05-27&tree=trunk

Comment 41

[Intermittent Failures Robot]

1 failures in 669 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-06-04&endday=2018-06-10&tree=trunk

Comment 42

[Intermittent Failures Robot]

1 failures in 521 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-06-18&endday=2018-06-24&tree=trunk

Comment 43

[Intermittent Failures Robot]

1 failures in 2672 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 2568 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 45

[Intermittent Failures Robot]

1 failures in 2902 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-esr60: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-09-17&endday=2018-09-23&tree=all

Comment 46

[Intermittent Failures Robot]

1 failures in 2708 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414144&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 47

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.