1225535 - test_marketplace_addon.py : TimeoutException: TimeoutException: Timed out after 10.1 seconds -

Status: RESOLVED WONTFIX

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Max Ivanov[:MaxIvanov]]

Description: Test case fails with "TimeoutException"

Steps:
1. Update a flame device to 20151117030236
2. Run this test case http://lxr.mozilla.org/gaia/source/tests/python/gaia-ui-tests/gaiatest/tests/functional/marketplace/test_marketplace_addon.py

Actual result:
"TimeoutException"

Expected result:
Test completes successfully.

Repro Rate: Reproduced via Jenkins adhoc (0/5 passing)
http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.ui.adhoc.bitbar/346/HTML_Report/

Traceback (most recent call last):
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/marionette_test.py", line 296, in run
testMethod()
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/marketplace/test_marketplace_addon.py", line 63, in test_search_and_install_app
marketplace.install_addon(self.addon_url)
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/apps/marketplace/app.py", line 103, in install_addon
addon_page.install_link()
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/apps/marketplace/app.py", line 116, in install_link
confirm_install.tap_confirm()
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/confirm_install.py", line 21, in tap_confirm
Wait(self.marionette).until(expected.element_displayed(confirm))
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_driver-1.0.0-py2.7.egg/marionette_driver/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 10.1 seconds

Comment 1

[Naoki Hirata :nhirata (please use needinfo instead of cc)]

Will need to check with a proper build.  Does this happen on 2.5?  Also please verify that the time is set correctly.

9473dbcbebf4e758a3b73200968efc69071b4312 is a 2.5 gaia pull.  We need to check to see if this is still valid once we get a proper build.

See build status in :
https://bugzilla.mozilla.org/show_bug.cgi?id=1224628
https://bugzilla.mozilla.org/show_bug.cgi?id=1225465

Comment 2

[Max Ivanov[:MaxIvanov]]

I cannot reproduce this issue manually but it failed in automation for the last few days. Possible something wrong with the script.

Comment 3

[Pi Wei Cheng [:piwei] (inactive)]

This bug is reproducible on today's Flame master. Running 'test_marketplace_addon.py' gives the following error:

Traceback (most recent call last):
File "/home/flash/gaia/tests/python/gaia-ui-tests/.env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/marionette_test.py", line 296, in run
testMethod()
File "/home/flash/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/marketplace/test_marketplace_addon.py", line 61, in test_search_and_install_app
marketplace.launch()
File "/home/flash/gaia/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 26, in launch
self.app = self.apps.launch(self.name, self.manifest_url, self.entry_point, launch_timeout=launch_timeout)
File "/home/flash/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 97, in launch
assert result, "Failed to launch app with manifest_url '%s'" % manifest_url
AssertionError: Failed to launch app with manifest_url 'https://marketplace.firefox.com/app/bee10fbb-7829-4d99-8a9f-a6d0a905138e/manifest.webapp'

Device: Flame 2.6 Master
BuildID: 20151120030231
Gaia: 94a821b49f4dca3f9321cd80e13c44c4a6696952
Gecko: 3835b568092ae3b71adc931d24928670ad7141a7
Gonk: 205ac4204bbbb2098a8046444acba551ba5dc75a
Version: 45.0a1 (2.6) 
Firmware Version: v18Dv4
User Agent: Mozilla/5.0 (Mobile; rv:45.0) Gecko/45.0 Firefox/45.0

After the test, time is correct on the device, so I assume time is correct during testing (it factory resets itself so I don't think me setting it to correct time prior to running test has any effect on test result)

Maybe there's an update on marketplace addon/app placement and the test just needs to be updated to match the update.

---------

The same error posted above is observed on Flame 2.5 as well.

Device: Flame 2.5
BuildID: 20151120073427
Gaia: b7f130c36588e308784cd1b7c8a28585c9819076
Gecko: 589a9b96c5bc632bcc336d0543442983cc1f61dd
Gonk: 205ac4204bbbb2098a8046444acba551ba5dc75a
Version: 44.0a2 (2.5) 
Firmware Version: v18Dv4
User Agent: Mozilla/5.0 (Mobile; rv:44.0) Gecko/44.0 Firefox/44.0

Comment 4

[Martijn Wargers (dead)]

Attachment: (PNG Image, 480 × 854 pixels) - Scaled (77%).png

The screenshot shows that the install button is greyed out when trying to run this test.
Did something change with the site that addon installation doesn't work anymore?

Comment 5

[krupa raj[:krupa]]

If the add-on has been previously installed, the install button will be greyed out. Please make sure that the add-on is uninstalled before you try reinstalling it.

Comment 6

[Martijn Wargers (dead)]

The add-on has not been installed previously. Actually, before any test is run, the contents of the device is wiped.

Comment 7

[krupa raj[:krupa]]

The screenshot doesn't have a "add-ons" tab in the navigation menu which makes me think that this is not 2.5. I also filed https://bugzilla.mozilla.org/show_bug.cgi?id=1227656

Comment 8

[Martijn Wargers (dead)]

Krupa, we're now loading the M-in-status bar add-on page directly, instead of doing the searching for the add-on, etc, because it was prone to failure.

This is indeed not 2.5, but mozilla-central. Is this only supposed to work for 2.5?

Comment 9

[krupa raj[:krupa]]

add-ons are supposed to work for 2.5 and higher.

Comment 10

[Martijn Wargers (dead)]

Ok, but Marketplace-Dev doesn't allow it. This needs to be fixed from the Marketplace side, I think.

Comment 11

[BMO Automation]

Firefox OS is not being worked on