1117784 - Investigate test_persona_standard_sign_in intermittent failure

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Robert Chira [:RobertC]]

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/87/HTML_Report/

test_persona_standard_sign_in is failing intermittently on Jenkins with the following error:

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/tests/functional/persona/test_persona_app.py", line 38, in test_persona_standard_sign_in
persona.login(self.user.email, self.user.password)
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/persona/app.py", line 30, in login
self.type_email(email)
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/persona/app.py", line 60, in type_email
self.keyboard.dismiss()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/keyboard/app.py", line 352, in dismiss
%(input_window.is_displayed(), input_window.get_attribute('class')))
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 29.5 seconds with message: Keyboard was not dismissed. Debug is_displayed(): False, class: inputWindow top-most.

The issue is not reproduced manually.
With automation I got a reproduction rate of 2 out of 10 on my local device.

From the screenshot it looks like the keyboard fails to close after typing the email.

Build info flame v2.2 319MB Full-Flash:
Device firmware (base) 	L1TC10011880
Device firmware (date) 	05 Jan 2015 01:34:36
Device firmware (incremental) 	eng.cltbld.20150105.043425
Device firmware (release) 	4.4.2
Device identifier 	flame
Gaia date 	02 Jan 2015 16:08:34
Gaia revision 	c2bf20d23851
Gecko build 	20150105010205
Gecko revision 	636498d041b5
Gecko version 	37.0a1

Comment 1

[Florin Strugariu [:Bebe]]

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.8.7-py2.7.egg/marionette/marionette_test.py", line 283, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/tests/functional/persona/test_persona_app.py", line 38, in test_persona_standard_sign_in
persona.login(self.user.email, self.user.password)
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/persona/app.py", line 35, in login
self.type_email(email)
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/persona/app.py", line 65, in type_email
self.keyboard.dismiss()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/keyboard/app.py", line 345, in dismiss
%(input_window.is_displayed(), input_window.get_attribute('class')))
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.8.7-py2.7.egg/marionette/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 28.5 seconds with message: Keyboard was not dismissed. Debug is_displayed(): True, class: inputWindow top-most active.


This has reproduced in today's(20150127010228) build

Comment 2

[Martijn Wargers (dead)]

I could fix this intermittent failure by using self.keyboard.send(value) in persona app.py, but then you get slow typing again.
I think this could also be fixed by switching context to the keyboard first in the keyboard dismiss() function.

Comment 3

[GitHub Autolander Bot]

Attachment: [PullReq] mwargers:persona to mozilla-b2g:master

Comment 4

[Martijn Wargers (dead)]

Comment on attachment 8561776 [details] [review]
[PullReq] mwargers:persona to mozilla-b2g:master

This passes 11 times on my device (while the test would fail every time, previously) and passes on b2g desktop for me.

Comment 5

[Johan Lorenzo [:jlorenzo]]

Kicked off jenkins job: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk.ui.adhoc/680/

Comment 6

[Johan Lorenzo [:jlorenzo]]

Comment on attachment 8561776 [details] [review]
[PullReq] mwargers:persona to mozilla-b2g:master

Ran 31 times without any issue in the jenkins job, r+.

Comment 7

[GitHub Autolander Bot]

Pull request has landed in master: https://github.com/mozilla-b2g/gaia/commit/9c8e17f93f551789ef59058a40f7a5eecec25969