1140027 - test_lockscreen_time_check.py intermittently fails checking the time at the lockscreen.

Status: RESOLVED WORKSFORME

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Martin Shuman [:Marty]]

Attachment: nonsmoke2.html

The test (test_lockscreen_time_check.py) is intermittently unable to correctly determine the time difference at the lockscreen.

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.9-py2.7.egg/marionette/marionette_test.py", line 290, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/tests/functional/lockscreen/test_lockscreen_time_check.py", line 68, in test_lockscreen_time_check
self.assertLessEqual(difference.seconds, 240)
AssertionError: 25200 not less than or equal to 240

Repro Rate: 14/20

I was unable to reproduce this issue manually after 10 attempts.

First failing:
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/66/testReport/%28root%29/test_lockscreen_time_check_py%20TestLockScreen_test_lockscreen_time_check/test_lockscreen_time_check_py_TestLockScreen_test_lockscreen_time_check/history/

Device firmware (base) 	L1TC100118D0
Device firmware (date) 	05 Mar 2015 01:32:30
Device firmware (incremental) 	eng.cltbld.20150305.043221
Device firmware (release) 	4.4.2
Device identifier 	flame
Gaia date 	04 Mar 2015 09:42:47
Gaia revision 	eff3321ab4e6
Gecko build 	20150305010212
Gecko revision 	56492f7244a9
Gecko version 	39.0a1

Comment 1

[Johan Lorenzo [:jlorenzo]]

Attachment: Gaia PR

Comment 2

[No-Jun Park [:njpark]]

Comment on attachment 8573946 [details] [review]
Gaia PR

7 hour difference means something is actually wrong with the device, but i agree that failing tests should be disabled for now.

Comment 3

[Johan Lorenzo [:jlorenzo]]

Merge the deactivate commit in master at: https://github.com/mozilla-b2g/gaia/commit/4894a491da3e68de17b873ca48db9519fd638628

Comment 4

[No-Jun Park [:njpark]]

It looks like when the script is grabbing the system time, the time data may not have been received yet.  Waiting until 1061797 is fixed.

Comment 5

[GitHub Autolander Bot]

Attachment: [gaia] npark-mozilla:1140027 > mozilla-b2g:master

Comment 6

[No-Jun Park [:njpark]]

This no longer reproduces in the latest nightly:

Build ID               20150408010203
Gaia Revision          84cbd4391fb7175d5380fa72c04d68873ce77e6d
Gaia Date              2015-04-07 17:33:14
Gecko Revision         https://hg.mozilla.org/mozilla-central/rev/078128c2600a
Gecko Version          40.0a1
Device Name            flame
Firmware(Release)      4.4.2
Firmware(Incremental)  eng.cltbld.20150408.044148
Firmware Date          Wed Apr  8 04:41:59 EDT 2015
Bootloader             L1TC000118D0


Adhoc Run link:
http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.ui.adhoc/778/