Closed Bug 1017101 Opened 11 years ago Closed 11 years ago

Intermittent Homescreen UI Tests failures: test_homescreen_delete_app.TestDeleteApp.test_delete_app, test_homescreen_launch_app.TestLaunchApp.test_launch_app : TimeoutException

Categories

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Product:
Firefox OS Graveyard
Component:
Gaia::UI Tests
Platform:
x86_64
Linux
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: julienw, Assigned: AndreiH)

Details

(Keywords: intermittent-failure)

TEST-START test_homescreen_delete_app.py test_delete_app (test_homescreen_delete_app.TestDeleteApp) ... ERROR ====================================================================== ERROR: None ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette_test.py", line 145, in run self.setUp() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/homescreen/test_homescreen_delete_app.py", line 33, in setUp confirm_install.tap_confirm() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/confirm_install.py", line 14, in tap_confirm self.wait_for_element_displayed(*self._confirm_install_button_locator) File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 42, in wait_for_element_displayed lambda m: m.find_element(by, locator).is_displayed()) File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/wait.py", line 143, in until cause=last_exc) TimeoutException: TimeoutException: Timed out after 10.0 seconds TEST-UNEXPECTED-FAIL | test_homescreen_delete_app.py test_homescreen_delete_app.TestDeleteApp.test_delete_app | ---------------------------------------------------------------------- Ran 1 test in 23.266s FAILED (errors=1) TEST-START test_homescreen_launch_app.py test_launch_app (test_homescreen_launch_app.TestLaunchApp) ... ERROR ====================================================================== ERROR: None ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette_test.py", line 145, in run self.setUp() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/homescreen/test_homescreen_launch_app.py", line 36, in setUp confirm_install.tap_confirm() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/confirm_install.py", line 14, in tap_confirm self.wait_for_element_displayed(*self._confirm_install_button_locator) File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 42, in wait_for_element_displayed lambda m: m.find_element(by, locator).is_displayed()) File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/wait.py", line 143, in until cause=last_exc) TimeoutException: TimeoutException: Timed out after 10.1 seconds TEST-UNEXPECTED-FAIL | test_homescreen_launch_app.py test_homescreen_launch_app.TestLaunchApp.test_launch_app | ---------------------------------------------------------------------- Ran 1 test in 23.341s FAILED (errors=1)
Link to the failure: https://travis-ci.org/mozilla-b2g/gaia/jobs/26209239#L2325 Cannot reproduce it on a local device.
Thanks for filing Julien. If we start seeing it more often, let's disable it. It hasn't been driving me too crazy, yet :)
Cannot believe this! I am tired of this test :( I will take a look over this and see what is causing this to fail again.
Assignee: nobody → andrei.hutusoru
Both test_homescreen_delete_app.TestDeleteApp and test_homescreen_launch_app.TestLaunchApp failed just in that build, the next builds are ok. I couldn't see any issue locally, which makes me to think that there was an issue with installing the app. (tests are ok).
Please let me know if these are failing again.
Don't worry, I will ;) I tried to file every intermittent I've seen lately because there has been a lot more than usual. Let's see if this speific one happens rarely enough.
Priority: -- → P1
This was only 1 time fail. I checked the builds, and these tests did not fail for 8 days now. I am going to close this bug. Please reopen if it fails again. Thanks! :)
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → WORKSFORME
This happened recently, see the following failing job, https://travis-ci.org/mozilla-b2g/gaia/jobs/29229653 test_launch_app (test_homescreen_launch_app.TestLaunchApp) ... ERROR ====================================================================== ERROR: None ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.10-py2.7.egg/marionette/marionette_test.py", line 170, in run testMethod() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/homescreen/test_homescreen_launch_app.py", line 49, in test_launch_app self.homescreen.installed_app(self.APP_NAME).tap_icon() File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/app.py", line 137, in tap_icon self.wait_for_condition(lambda m: self.apps.displayed_app.name.lower() == expected_name.lower()) File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 54, in wait_for_condition Wait(self.marionette, timeout).until(method, message=message) File "/home/travis/build/mozilla-b2g/gaia/travis_venv/local/lib/python2.7/site-packages/marionette_client-0.7.10-py2.7.egg/marionette/wait.py", line 143, in until cause=last_exc) TEST-UNEXPECTED-FAIL | test_homescreen_launch_app.py test_homescreen_launch_app.TestLaunchApp.test_launch_app | TimeoutException: TimeoutException: Timed out after 10.2 seconds
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---
This is a different fail Rudy, but I will look over this. Thanks!
I cannot reproduce this locally, but I opened PR https://travis-ci.org/mozilla-b2g/gaia/jobs/29299101 just to run this test, let's see how it performs. Since the failure is a different one maybe we should open another bug if this is really something that can be fixed in our tests.
Sure, let's just disable the test for desktop right now. I will open another bug for this since it is another test and it fails for a different reason.
Flags: needinfo?(andrei.hutusoru)
Status: REOPENED → RESOLVED
Closed: 11 years ago → 11 years ago
Resolution: --- → FIXED
Opened bug 1035136
You need to log in before you can comment on or make changes to this bug.