Closed
Bug 938657
Opened 11 years ago
Closed 10 years ago
[UITests] Intermittent Travis UI Test failure: TEST-UNEXPECTED-FAIL | test_persona_app.py test_persona_app.TestPersonaStandard.test_persona_standard_sign_in | TimeoutException: Element li.login not present before timeout
Categories
(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)
Tracking
(Not tracked)
RESOLVED
WONTFIX
People
(Reporter: julienw, Assigned: edwong)
References
Details
File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.6.2-py2.7.egg/marionette/marionette_test.py", line 143, in run testMethod() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/persona/test_persona_app.py", line 41, in test_persona_standard_sign_in uitests.wait_for_login_event() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/ui_tests/app.py", line 88, in wait_for_login_event self.wait_for_element_displayed(*self._app_login_event) File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 66, in wait_for_element_displayed raise TimeoutException('Element %s not present before timeout' % locator) TEST-UNEXPECTED-FAIL | test_persona_app.py test_persona_app.TestPersonaStandard.test_persona_standard_sign_in | TimeoutException: Element li.login not present before timeout ---------------------------------------------------------------------- Ran 1 test in 69.182s FAILED (errors=1)
Comment 1•11 years ago
|
||
Ed Wong and I have been talking about this offline already. It occurs on device and on Travis.
Assignee: nobody → edwong
Comment 2•11 years ago
|
||
I passed this test on both b2g-desktop and device (Unagi) with gaia commit d523f4bf685385b49e60cbc8ea5c15700a83dead. What's your b2g & gaia version when you have this problem?
Reporter | ||
Comment 3•11 years ago
|
||
It happened on Travis yesterday so it was a gaia+gecko from yesterday ;) As I've written this is intermittent so this only happens from time to time... Remember Travis uses very slow VMs.
Comment 4•11 years ago
|
||
This has been intermittent for a few weeks. Ed and I have been investigating offline. It's not related to a Gecko/Gaia commit. It's about a 1 in 50 failure on device testing too.
Assignee | ||
Comment 5•11 years ago
|
||
Here are my results: * 2 fails out of 100 with desktopB2G with no prefs set and default profile * 0 fails out of 200 with desktop B2G with toolkit.idenity.debug = true and default profile * 0 fails out of 100 on Inari with toolkit.idenity.debug = true, with wifi toggle off (to speed up the process) and running logcat I do notice the test takes 20% longer on the 100th run (~60sec) vs the 1st run (~50sec). It's possible that debugging on is causing a race condition to be hidden. I can try again with wifi toggling and restarting between runs. But this is chewing up my time to work on other things of course.
Comment 6•11 years ago
|
||
You have to run with restart, to replicate as close as possible the real CI environment.
Comment 7•11 years ago
|
||
Is it possible to be related to network problem? The login page will not show if I turn on airplane mode (of course.) But even when I turn off airplane mode later, this page does not refresh and remains blank. So if there are some network problems (DNS fail, lag, etc.) during the test, the test will probably stall forever.
Updated•10 years ago
|
OS: Linux → Gonk (Firefox OS)
Priority: -- → P1
Hardware: x86_64 → Other
Comment 9•10 years ago
|
||
This test is now disabled because of this intermittent issue. We really need to try and debug and re-enable this.
Comment 10•10 years ago
|
||
REPEAT 100 ------- test_persona_standard_sign_in (test_persona_app.TestPersonaStandard) ... ok ---------------------------------------------------------------------- Ran 1 test in 35.180s OK SUMMARY ------- passed: 101 failed: 0 todo: 0
Comment 11•10 years ago
|
||
Ran it on Travis with repeat 100 and at the 21 run the fail still reproduces [1]. The build timedout after 50 minutes. I will begin testing this locally and investigate, running tests using the Travis scripts, and hopefully we can come up with a fix [1] https://travis-ci.org/mozilla-b2g/gaia/jobs/17340169
Comment 12•10 years ago
|
||
Looks like this was fixed and it's working OK for some time
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → WONTFIX
You need to log in
before you can comment on or make changes to this bug.
Description
•