1351931 - Intermittent test_crash.py TestCrashInSetUp.test_crash_in_setup | AssertionError: "Process crashed" does not match "Process killed because the connection to Marionette server is lost. Check gecko.log for errors (Reason: Connection timed out after 10s)"

Status: RESOLVED DUPLICATE of bug 1377030

(Testing :: Marionette Client and Harness, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=87320068&repo=mozilla-central

https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-central-win64-pgo/1490797904/mozilla-central_win8_64_test_pgo-marionette-e10s-bm119-tests1-windows-build6.txt.gz

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

We should crash immediately for those unit tests but somehow it has been taken more than a minute:

> 09:40:13     INFO -  TEST-START | test_crash.py TestCrashInSetUp.test_crash_in_setup
> 09:41:29    ERROR -  TEST-UNEXPECTED-ERROR | test_crash.py TestCrashInSetUp.test_crash_in_setup | AssertionError: "Process crashed" does not match "Process killed because the connection to Marionette server is lost. Check gecko.log for errors (Reason: Connection timed out after 10s)"

Maybe something wrong with the machine the test was running on? I would need more data for that.

Comment 2

[Intermittent Failures Robot]

7 failures in 770 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* mozilla-inbound: 2

Platform breakdown:
* osx-10-10: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-05-01&endday=2017-05-07&tree=all

Comment 3

[Intermittent Failures Robot]

16 failures in 879 pushes (0.018 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 10
* mozilla-inbound: 4
* mozilla-central: 2

Platform breakdown:
* osx-10-10: 16

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-05-08&endday=2017-05-14&tree=all

Comment 4

[Intermittent Failures Robot]

15 failures in 777 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 8
* mozilla-inbound: 7

Platform breakdown:
* osx-10-10: 15

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-05-15&endday=2017-05-21&tree=all

Comment 5

[Intermittent Failures Robot]

12 failures in 891 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 7
* mozilla-inbound: 2
* mozilla-central: 2
* try: 1

Platform breakdown:
* osx-10-10: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-05-22&endday=2017-05-28&tree=all

Comment 6

[Intermittent Failures Robot]

21 failures in 820 pushes (0.026 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 11
* autoland: 9
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 21

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-05-29&endday=2017-06-04&tree=all

Comment 7

[Intermittent Failures Robot]

24 failures in 864 pushes (0.028 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 14
* autoland: 7
* try: 2
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 24

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-06-05&endday=2017-06-11&tree=all

Comment 8

[Intermittent Failures Robot]

14 failures in 814 pushes (0.017 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 7
* autoland: 7

Platform breakdown:
* osx-10-10: 12
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-06-12&endday=2017-06-18&tree=all

Comment 9

[Intermittent Failures Robot]

23 failures in 892 pushes (0.026 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 13
* mozilla-inbound: 6
* mozilla-central: 2
* mozilla-beta: 2

Platform breakdown:
* osx-10-10: 21
* windows7-32-vm: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-06-19&endday=2017-06-25&tree=all

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

:whimboo this test has failed consistently for a few months, it seems to have picked up slightly in frequency in the last few weeks for osx, is there someone who could take a brief look at this?

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+2]]

With bug 1223277 I kinda change the implementation of the unit crash tests for Marionette. Lets wait until this got landed.

Comment 12

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This should be blocked on bug 1376795.

Comment 13

[Intermittent Failures Robot]

6 failures in 718 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 3
* mozilla-beta: 2
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 4
* macosx64-devedition: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-06-26&endday=2017-07-02&tree=all

Comment 14

[Intermittent Failures Robot]

5 failures in 656 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 5

Platform breakdown:
* osx-10-10: 3
* macosx64-devedition: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 720 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 16

[Intermittent Failures Robot]

4 failures in 822 pushes (0.005 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 3
* mozilla-esr52: 1

Platform breakdown:
* macosx64-devedition: 2
* windows8-64: 1
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 912 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr52: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures in 792 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-esr52: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2017-11-27&endday=2017-12-03&tree=all

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Bug 1377030 is more active these days.

Comment 21

[Intermittent Failures Robot]

2 failures in 788 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2018-01-08&endday=2018-01-14&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 675 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 747 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1351931&startday=2018-03-05&endday=2018-03-11&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 551 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1351931&startday=2018-04-30&endday=2018-05-06&tree=trunk

Comment 25

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.