960240 - Re-enable test: test_persona_cookie.py test_persona_cookie.TestPersonaCookie.test_persona_cookie

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Description

[Kevin Grandon :kgrandon]

test_persona_cookie (test_persona_cookie.TestPersonaCookie) ... ERROR

======================================================================

ERROR: None

----------------------------------------------------------------------

Traceback (most recent call last):

File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.2-py2.7.egg/marionette/marionette_test.py", line 143, in run

testMethod()

File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/persona/test_persona_cookie.py", line 39, in test_persona_cookie

self.wait_for_element_displayed(*self._logged_out_button_locator, timeout=120)

File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 1034, in wait_for_element_displayed

raise TimeoutException('Element %s present but not displayed before timeout' % locator)

TEST-UNEXPECTED-FAIL | test_persona_cookie.py test_persona_cookie.TestPersonaCookie.test_persona_cookie | TimeoutException: Element #signinhere .btn-persona present but not displayed before timeout

----------------------------------------------------------------------

Ran 1 test in 160.565s

FAILED (errors=1)

Comment 1

[Kevin Grandon :kgrandon]

Zac - this test was disabled for intermittent failures in: https://github.com/KevinGrandon/gaia/commit/cd728253dc51cad672a4860d3599df235f54631b

Potentially related to bug 956165? Ni? so you are aware.

Comment 2

[Zac C (:zac)]

Thanks Kevin, it was quite stable but seems to have flared up again. we'll look into it again.

Comment 3

[[:AndreiH]]

Tried to run both tests on Travis with repeat 100 but Travis is configured to timeout after 50 minutes
The run got to repeat= 26. I will skip the second test 
https://travis-ci.org/mozilla-b2g/gaia/jobs/17340169

Comment 4

[[:AndreiH]]

Run test_persona_cookie.py on Travis with repeat 100, sadly got only to repeat 41 and the successfully passed [1].
I will start testing this locally to reach 100 runs using the Travis scripts, and then report back.

Here is the run on Travis:

[1] https://travis-ci.org/mozilla-b2g/gaia/jobs/17346021

Comment 5

[[:AndreiH]]

I ran this test locally using the Travis scripts, repeat over 100. I Search Results accidentally stopped the first run at repeat 36, and restarted the runs again with a repeat of 75 times. Could not reproduce the fail. From my part, we can re-enable the coverage for this test.

Here are the results locally:
https://pastebin.mozilla.org/4073250

Comment 6

[Zac C (:zac)]

Let's aim to re-enable this coverage.

What we need to do is run it on Travis with --repeat to assert the stability.

Comment 7

[Zac C (:zac)]

Oops I mis-read Andrei's comment!

Let's re-enable this straight away then :)

Comment 8

[[:AndreiH]]

Attachment: Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15715

Comment 9

[Zac C (:zac)]

Comment on attachment 8365863 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15715

r-, this is failing because of https://bugzilla.mozilla.org/show_bug.cgi?id=963582

We can change it to expected = fail

Comment 10

[[:AndreiH]]

Comment on attachment 8365863 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15715

Updated the manifest

Comment 11

[Zac C (:zac)]

Merged:
https://github.com/mozilla-b2g/gaia/commit/e3e659ac5cc6087f1c981d02438ab6e844271392

Comment 12

[Zac C (:zac)]

Re-enabled proper:
https://github.com/mozilla-b2g/gaia/commit/0783aa5a417e404f5d2034f236137a1582580c7f