1079254 - [v2.2] Investigate test_number_keyboard intermittent failure

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Robert Chira [:RobertC]]

Attachment: test_number_keyboard.webm

test_number_keyboard started failing on Jenkins:
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.ui.functional.non-smoke/31/console

TEST-UNEXPECTED-FAIL | test_number_keyboard.py TestNumberKeyboard.test_number_keyboard | AssertionError: 'en' != 'number'
 
 Traceback (most recent call last):
   File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke/.env/local/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette_test.py", line 264, in run
     testMethod()
   File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke/tests/python/gaia-ui-tests/gaiatest/tests/functional/keyboard/test_number_keyboard.py", line 22, in test_number_keyboard
     self.assertEqual(str(keyboard.current_keyboard), 'number')

Issue cannot be reproduced manually.
With automation I got a reproduction rate of 1 out of 20.

Build info v2.2 flame:
Gaia-Rev        83de447d9ae9a59459d7a445f9348a254c661850
Gecko-Rev       https://hg.mozilla.org/mozilla-central/rev/9ee9e193fc48
Build-ID        20141007040205
Version         35.0a1
Device-Name     flame
FW-Release      4.4.2
FW-Incremental  eng.cltbld.20141007.071347
FW-Date         Tue Oct  7 07:13:58 EDT 2014
Bootloader      L1TC10011800

Due to the low reproduction rate I cannot get a regression window. 
I added a screencast of the test failing, it looks like the test fails right after opening the keyboard.

Comment 1

[Viorela Ioia [:viorela]]

Attachment: Github PR: https://github.com/mozilla-b2g/gaia/pull/25328

Comment 2

[Zac C (:zac)]

Comment on attachment 8507873 [details] [review]
Github PR: https://github.com/mozilla-b2g/gaia/pull/25328

r+!

Comment 3

[Robert Chira [:RobertC]]

Comment on attachment 8507873 [details] [review]
Github PR: https://github.com/mozilla-b2g/gaia/pull/25328

Merged on master:

https://github.com/mozilla-b2g/gaia/commit/bae49d63304b4980c7f17681ba87bec38d6eb8ca

Comment 4

[Robert Chira [:RobertC]]

Viorela, does this need to be uplifted to v2.1?

Comment 5

[Viorela Ioia [:viorela]]

Attachment: Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/25372

uplift to v2.1

Comment 6

[Florin Strugariu [:Bebe]]

Comment on attachment 8508755 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/25372

LGTM


Merge

Comment 7

[Florin Strugariu [:Bebe]]

https://github.com/mozilla-b2g/gaia/commit/4f7d614e65622297e715a3a3ca22f03e738183be