1023251 - Investigate keyboard test failures

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Description

[Florin Strugariu [:Bebe]]

Description:
All our tests using the Keyboard are failing in latest 2.1 build

Environment:

Gaia      f42ebc93554979501d3ac52bcf9e69cb4b310a4f
Gecko     https://hg.mozilla.org/mozilla-central/rev/9dc0ffca10f4
BuildID   20140610040208
Version   33.0a1
ro.build.version.incremental=94
ro.build.date=Tue May 20 09:29:20 CST 2014


Traceback (most recent call last):

File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette_test.py", line 163, in run
testMethod()
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/browser/test_browser_cell_data.py", line 25, in test_browser_cell_data
browser.go_to_url('http://mozqa.com/data/firefox/layout/mozilla.html', timeout=120)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/browser/app.py", line 47, in go_to_url
self.keyboard.send(url)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/keyboard/app.py", line 234, in send
self._switch_to_correct_layout(val)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/keyboard/app.py", line 122, in _switch_to_correct_layout
self.wait_for_element_displayed(*self._key_locator(self._alpha_key))
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 42, in wait_for_element_displayed
lambda m: m.find_element(by, locator).is_displayed())
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/wait.py", line 143, in until
cause=last_exc)
TimeoutException: Traceback (most recent call last):
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/wait.py", line 122, in until
rv = condition(self.marionette)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 42, in <lambda>
lambda m: m.find_element(by, locator).is_displayed())
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette.py", line 1204, in find_element
response = self._send_message('findElement', 'value', **kwargs)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/decorators.py", line 35, in _
return func(*args, **kwargs)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette.py", line 624, in _send_message
self._handle_error(response)
File "/var/jenkins/workspace/b2g.flame.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.7-py2.7.egg/marionette/marionette.py", line 655, in _handle_error
raise NoSuchElementException(message=message, status=status, stacktrace=stacktrace)
TimeoutException: Timed out after 20.2 seconds, caused by <class 'marionette.errors.NoSuchElementException'>


Reproducible manually: NO

I manually tested on Flame and the keyboard works as expected

STR:
Run test_browser_cell_data.TestBrowserCellData or any test that is using the keyboard to type text


Possible cause: 

From the tinderbox build it looks like the changed appearer between:

Good:    http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Flame/job/b2g.flame.mozilla-central.tinderbox.ui/24/HTML_Report/


Device firmware (date) 	19 May 2014 18:29:20
Device firmware (incremental) 	94
Device firmware (release) 	4.3
Device identifier 	msm8610
Gaia date 	09 Jun 2014 03:43:55
Gaia revision 	d283b742a12a
Gecko build 	20140609115635
Gecko revision 	349a2f003529
Gecko version 	33.0a1


Bad:   http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Flame/job/b2g.flame.mozilla-central.tinderbox.ui/25/HTML_Report/


Device firmware (date) 	19 May 2014 18:29:20
Device firmware (incremental) 	94
Device firmware (release) 	4.3
Device identifier 	msm8610
Gaia date 	09 Jun 2014 03:43:55
Gaia revision 	d283b742a12a
Gecko build 	20140609134640
Gecko revision 	437a4bfb3838
Gecko version 	33.0a1

Comment 1

[Jason Smith [:jsmith]]

Looks like a gecko regression. The gaia commits above are exactly the same.

Comment 2

[Jason Smith [:jsmith]]

http://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=349a2f003529&tochange=437a4bfb3838

Comment 3

[Jason Smith [:jsmith]]

We need to bisect this. Using builds from https://pvtbuilds.mozilla.org/pvt/mozilla.org/b2gotoro/tinderbox-builds/mozilla-inbound-flame-eng/, let's find out the last working build & first broken build.

Comment 4

[Florin Strugariu [:Bebe]]

We talked with mdas on IRC and she is pretty sure it's her marionette patch:

http://hg.mozilla.org/mozilla-central/rev/a8ad10daa7c0

Comment 5

[Jason Smith [:jsmith]]

Fixed via backout then.