1046690 - [v2.0] Tests are failing during setup, apps are failing to close

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Description

[Viorela Ioia [:viorela]]

All tests running on v2.0 are failing during setup, when trying to kill all running apps. It looks like there is at least one app that fails to close. 

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/marionette_test.py", line 152, in run
self.setUp()
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/tests/functional/browser/test_browser_cell_data.py", line 16, in setUp
GaiaTestCase.setUp(self)
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 684, in setUp
self.cleanup_gaia(full_reset=False)
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 729, in cleanup_gaia
self.apps.kill_all()
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 88, in kill_all
self.marionette.execute_async_script("GaiaApps.killAll()")
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/marionette.py", line 1186, in execute_async_script
filename=os.path.basename(frame[0]))
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/decorators.py", line 35, in _
return func(*args, **kwargs)
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/marionette.py", line 633, in _send_message
self._handle_error(response)
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/marionette.py", line 692, in _handle_error
raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
ScriptTimeoutException: ScriptTimeoutException: timed out

Last working build:
Gaia      2e85678de2c8e13e585288d4cec7d6673cee17ee
Gecko     https://hg.mozilla.org/releases/mozilla-b2g32_v2_0/rev/6e37ecf873da
BuildID   20140730062554
Version   32.0
ro.build.version.incremental=109
ro.build.date=Mon Jun 16 16:51:29 CST 2014
B1TC00011220

First failing build: 
Gaia      9369f7f9a4795d7d554c6c1ddb3c7daee3e4f994
Gecko     https://hg.mozilla.org/releases/mozilla-b2g32_v2_0/rev/a07797dc0fe8
BuildID   20140730160202
Version   32.0
ro.build.version.incremental=109
ro.build.date=Mon Jun 16 16:51:29 CST 2014
B1TC00011220


Jenkins report: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame.mozilla-b2g32_v2_0.ui.functional.smoke/21/HTML_Report/

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I had a look into this for Viorela and it seems that when we try to kill all apps we have both Homescreen and Vertical homescreen running. As we wait for there to be <= 1 apps running, this times out. When I query independently there only appears to be a single homescreen app running though, which is strange. It's like the number of running apps is somehow cached.

Here's the relevant JavaScript code: https://github.com/mozilla-b2g/gaia/blob/f33c6a11a2e03833e17e43d23be8cc05ea99445a/tests/atoms/gaia_apps.js#L202

Viorela: Could you try cherry-picking https://github.com/mozilla-b2g/gaia/commit/751c53c1b35a81345b36c15c2f369f3218f60e0f to v2.0 to see if that resolves this?

Comment 2

[Florin Strugariu [:Bebe]]

Updating the priority as this issue is blocking us to run automation on 2.0

Comment 3

[Viorela Ioia [:viorela]]

(In reply to Dave Hunt (:davehunt) from comment #1)
> I had a look into this for Viorela and it seems that when we try to kill all
> apps we have both Homescreen and Vertical homescreen running. As we wait for
> there to be <= 1 apps running, this times out. When I query independently
> there only appears to be a single homescreen app running though, which is
> strange. It's like the number of running apps is somehow cached.
> 
> Here's the relevant JavaScript code:
> https://github.com/mozilla-b2g/gaia/blob/
> f33c6a11a2e03833e17e43d23be8cc05ea99445a/tests/atoms/gaia_apps.js#L202
> 
> Viorela: Could you try cherry-picking
> https://github.com/mozilla-b2g/gaia/commit/
> 751c53c1b35a81345b36c15c2f369f3218f60e0f to v2.0 to see if that resolves
> this?

I cherry-picked the commit to v2.0, but it didn't fix the issue.

Comment 4

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I was able to fix this by cherry-picking a bunch of commits from master.

Comment 5

[Viorela Ioia [:viorela]]

Closing this as the the issue was fixed by uplifts from master, tests are passing on v2.0: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame.mozilla-b2g32_v2_0.ui.functional.non-smoke/23/console