1034630 - Investigate failures caused by Homescreen not finish loading before timeout

Status: RESOLVED WONTFIX

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Viorela Ioia [:viorela]]

Both test_lockscreen_wake_with_notification.py and test_homescreen_move_app.py have failed in the latest master build. From the  because of Homescreen not being able to finish loading before timeout.
I was not able to reproduce the issue locally, by running the automated tests, or manually.
It is not reproducible on v2.0 either. 
We need to still investigate this.

Traceback (most recent call last):
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.10-py2.7.egg/marionette/marionette_test.py", line 152, in run
self.setUp()
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/homescreen/test_homescreen_move_app.py", line 12, in setUp
GaiaTestCase.setUp(self)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 657, in setUp
self.device.start_b2g()
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 522, in start_b2g
By.CSS_SELECTOR, '#homescreen[loading-state=false]'))
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.10-py2.7.egg/marionette/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 60.1 seconds


Jenkins report: http://selenium.qa.mtv2.mozilla.com:8080/job/b2g.flame.mozilla-central.ui.smoketest/111/HTML_Report/
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Flame/job/b2g.flame.mozilla-central.ui.non-smoketest/114/HTML_Report/

Comment 1

[Viorela Ioia [:viorela]]

I've investigated this issue and I was able to reproduce a similar failure. It is very intermittent, I ran the test > 40 times and it failed once: https://pastebin.mozilla.org/5533559. And when it failed, my phone crashed.
Unfortunately, I didn't get the log when the test failed , so I can't realise why did it crashed.
I re-ran the test in a loop a lot of times, but I couldn't reproduce the failure again, it is intermittent, but very rarely reproducible. 
I didn't see any of this tests failing in Jenkins with this failure, on any of this week's builds.
I'll keep an eye on the bug, and try to get a log and more info. 

Build info:
Gaia      740faa5d0060fb218b407cf224330654ddf833a5
Gecko     https://hg.mozilla.org/mozilla-central/rev/465280604ea6
BuildID   20140708040218
Version   33.0a1
ro.build.version.incremental=108
ro.build.date=Tue Jun 10 19:40:40 CST 2014


N? myself to update the bug with more details by the end of the week.

Comment 2

[Viorela Ioia [:viorela]]

I haven't seen this failing on Jenkins this week. Also, I ran both tests locally and they were good.
I will close the bug, as it is not reproducible anymore. Reopen, if needed.

Comment 3

[Viorela Ioia [:viorela]]

I had to reopen this bug, as I saw test_homescreen_edit_mode.py failing with the same error in today's master build. I wasn't able to reproduce the failure locally, as I ran the test several times: https://pastebin.mozilla.org/5615597
We need to still investigate the failure. 

Gaia      3a06aa58245eaf848242d6d1497c1af536fffabd
Gecko     https://hg.mozilla.org/mozilla-central/rev/6c0971104909
BuildID   20140725040205
Version   34.0a1
ro.build.version.incremental=109
ro.build.date=Mon Jun 16 16:51:29 CST 2014

Jenkins report: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame.mozilla-central.ui.functional.non-smoke/30/HTML_Report/

Comment 4

[Zac C (:zac)]

Attachment: hs_startup_html_dump.html

We're getting this a lot more on Flame 319mb and as such I've been able to replicate it locally and provide debug info.

I think it is a real bug but I'll ni? Kgrandon for more info before we move this bug to a different component.

Kevin, this occurs when we stop/delete profile/re-start the b2g process on device.

We are waiting for the homescreen to have finished loading behind the FTU, which it usually does fine. 

Looking at the html dump you can see the homescreen's window has not got loading-state=false applied to it.

If I take control of the device after we see this error and close the FTU, the homescreen/icons etc are not present. Only statusbar/wallpaper are visible.



Device    Flame
Memory    319mb
Gaia      25e998814ba89f30fe44cd2fdfbb44d160a04641
Gecko     https://hg.mozilla.org/mozilla-central/rev/08c23f12a43e
BuildID   20140730045709
Version   34.0a1
ro.build.version.incremental=110
ro.build.date=Fri Jun 27 15:57:58 CST 2014
B1TC00011230

Comment 5

[Zac C (:zac)]

Attachment: hs_startup_fail.log

Comment 6

[Kevin Grandon :kgrandon]

I think I have seen this before, but do not have a STR. My guess is that there might be a real bug here in the system app. TBH - I don't know where to start debugging this one.

Comment 7

[Zac C (:zac)]

I've got to get a better logcat. The previous one was filtered by Gecko|Gonk.

Comment 8

[Viorela Ioia [:viorela]]

This issue is still reproducible. Random tests are failing with this error: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame.mozilla-central.ui.functional.non-smoke/81/HTML_Report/

I was able to reproduce it locally, by running a unit test several times - test_bt_enabled_and_disabled.py. Also, I was able to get a logcat of the issue.  

Device: Flame
Memory: 319mb
Gaia      9f35fca9d818b26c06aa6b7e5c0bef25886f8f20
Gecko     https://hg.mozilla.org/mozilla-central/rev/7fc96293ada8
BuildID   20140812160208
Version   34.0a1
ro.build.version.incremental=109
ro.build.date=Mon Jun 16 16:51:29 CST 2014
B1TC00011220

Comment 9

[Viorela Ioia [:viorela]]

Attachment: logcat.txt

Comment 10

[Stephen Donner [:stephend] Not actively reading bugmail]

See also bug 1050764.

Comment 11

[Viorela Ioia [:viorela]]

This issue was reproducible in the latest v2.0 build: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame.mozilla-b2g32_v2_0.ui.functional.smoke/79/HTML_Report/
I was not able to reproduce the failure locally, by running the test several times

Device firmware (date)     23 Jul 2014 07:25:46
Device firmware (incremental)     eng.cltbld.20140723.102536
Device firmware (release)     4.3
Device identifier     flame
Gaia date     25 Aug 2014 18:19:03
Gaia revision     a51633e29a78
Gecko build     20140826000204
Gecko revision     fdac649a65ac
Gecko version     32.0

Comment 12

[Zac C (:zac)]

This is too difficult to reproduce but also known by the devs elsewhere and they're trying to fix it there instead.

Comment 13

[Robert Chira [:RobertC]]

This issue reappeared in todays v2.1 test run.
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-b2g34_v2_1.ui.functional.smoke/92/HTML_Report/

I've seen this test fail before, but it is very rare.

Kevin, regarding comment 12, are the devs still working on this or do you have a bug number?

Comment 14

[Kevin Grandon :kgrandon]

I'm not aware of any work anywhere to address this. If this is still happening let's track it here if the stacktrace is the same as originally reported, otherwise let's open a new bug.

Comment 15

[BMO Automation]

Firefox OS is not being worked on