1190513 - test_spark_apps_present.py: Spark not available on flame builds flashed for automation

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Oliver Nelson [:oliverthor]]

Description:
test_spark_apps_present is being run against flame builds on Jenkins. Currently, flame devices do not support Spark apps so this has a 100% fail since it has been added. There is a spark tag in the respective 'manifest.ini' file for homescreen, but it appears the bitbar runs are not excluding them from the test runs.

Actual:
test_spark_apps_present fails in jenkins runs

Expected: 
test_spark_apps_present is disabled for flame runs

Traceback (most recent call last):
  File "/var/lib/jenkins/jobs/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-0.16-py2.7.egg/marionette/marionette_test.py", line 296, in run
    testMethod()
  File "/var/lib/jenkins/jobs/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/homescreen/test_spark_apps_present.py", line 17, in test_spark_apps_are_present
    homescreen.wait_for_app_icon_present(expected_app)
  File "/var/lib/jenkins/jobs/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/app.py", line 47, in wait_for_app_icon_present
    Wait(self.marionette, timeout=30).until(lambda m: self.installed_app(app_name))
  File "/var/lib/jenkins/jobs/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_driver-0.9-py2.7.egg/marionette_driver/wait.py", line 143, in until
    cause=last_exc)

TimeoutException: TimeoutException: Timed out after 30.9 seconds


Environmental Variables:
Device firmware (base) 	L1TC000118D0
Device firmware (date) 	03 Aug 2015 10:34:32
Device firmware (incremental) 	eng.cltbld.20150803.063420
Device firmware (release) 	4.4.2
Device identifier 	flame
Device memory 	219772 kB
Device serial 	1d9a563d
Device uptime 	0 days 0 hours 2 minutes 39 seconds
Gaia date 	31 Jul 2015 08:23:31
Gaia revision 	2ca27bbdd845
Gecko build 	20150803030210
Gecko revision 	32712cd01159
Gecko version 	42.0a1

Reproducible manually: Yes? (Spark apps not default on flame)

Repro frequency: 5/5

Comment 1

[Oliver Nelson [:oliverthor]]

First appearance:
* http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/200/
Latest: 
* http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/207/

Stability:
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/207/testReport/junit/%28root%29/test_spark_apps_present_py%20TestSparkAppsArePresent_test_spark_apps_are_present/test_spark_apps_present_py_TestSparkAppsArePresent_test_spark_apps_are_present/history/

Comment 2

[Johan Lorenzo [:jlorenzo]]

Sorry about that, I forgot to add -spark to that job too. I just did it.