956127 - [UITests] Travis Intermittent: test_system_message.py test_system_message.TestSystemMessages.test_app_launched_by_system_message

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Description

[Kevin Grandon :kgrandon]

test_system_message.py test_system_message.TestSystemMessages.test_app_launched_by_system_message


test_app_launched_by_system_message (test_system_message.TestSystemMessages) ... ERROR

======================================================================
ERROR: None
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.7.1-py2.7.egg/marionette/marionette_test.py", line 127, in run
    self.setUp()
  File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 834, in setUp
    self.device.start_b2g()
  File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 742, in start_b2g
    self.marionette.start_session()
  File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.7.1-py2.7.egg/marionette/marionette.py", line 681, in start_session
    self.session = self._send_message('newSession', 'value')
  File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.7.1-py2.7.egg/marionette/marionette.py", line 562, in _send_message
    response = self.client.send(message)
  File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.7.1-py2.7.egg/marionette/client.py", line 85, in send
    self.connect()
  File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.7.1-py2.7.egg/marionette/client.py", line 67, in connect
    self.sock.connect((self.addr, self.port))
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
TEST-UNEXPECTED-FAIL | test_system_message.py test_system_message.TestSystemMessages.test_app_launched_by_system_message | error: [Errno 111] Connection refused
----------------------------------------------------------------------
Ran 1 test in 60.914s

FAILED (errors=1)

Comment 1

[Kevin Grandon :kgrandon]

Disabled the test in: https://github.com/mozilla-b2g/gaia/commit/3dd699ab8fb85f70ea3472d9fbc1a2522f78e580

Comment 2

[Zac C (:zac)]

This is an interesting one; it is failing in the setUp before it even gets to the test.

It's possible the previous test is leaving b2g in a bad state.

Comment 3

[[:AndreiH]]

I cannot reproduce this, I run all the tests from system on desktop repeating over 30 times, since Zac suggested that it's possible for a previous test to leave b2g in a bad state.
I don't really know if my methods were correct in investigating this. Do you have other suggestions on how to try to replicate this?

Comment 4

[Kevin Grandon :kgrandon]

I saw this on Travis only twice in ~200 runs. I believe it was the only failure each time. Unfortunately I don't have much more information than that.

Comment 5

[Florin Strugariu [:Bebe]]

Ran this a bunch of times locally and it works... Let's see what Travis thinks 


REPEAT 25
-------
test_app_launched_by_system_message (test_system_message.TestSystemMessages) ... ok

----------------------------------------------------------------------
Ran 1 test in 12.364s

OK

SUMMARY
-------
passed: 26
failed: 0
todo: 0

Comment 6

[Florin Strugariu [:Bebe]]

Let's enable this and see how it goes...

Comment 7

[Zac C (:zac)]

Bebe, before you re-enable this can you do a Travis run that repeats the test 200 times?

I think this bug might be improved by bug 956780.

Comment 8

[Florin Strugariu [:Bebe]]

Zac https://travis-ci.org/mozilla-b2g/gaia/jobs/16868280 
Let's see how it looks like :D

Comment 9

[Florin Strugariu [:Bebe]]

SUMMARY
-------
passed: 201
failed: 0
todo: 0

Looks like we are good :D

Comment 10

[Florin Strugariu [:Bebe]]

Attachment: pull request

Comment 11

[Trif Andrei-Alin[:AlinT]]

Comment on attachment 8359265 [details] [review]
pull request

r+

Comment 12

[Bob Silverberg [:bsilverberg]]

Comment on attachment 8359265 [details] [review]
pull request

Landed in https://github.com/mozilla-b2g/gaia/commit/4eb1a3ba2b825e210a25f14faacc11c7a7f4e861. If it pops up as an intermittent again we'll have to take another look.