1202831 - test_findmydevice.py: "TimeoutException: TimeoutException: Timed out after 61.4 seconds"

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Nicholas Nelson [:NicholasN]]

Description:
This test appears to fail after Find My Device is enabled in settings. Running this test locally, it fails to unlock the sim and connect to the internet, so the test ends on the homescreen. When running the test manually, I am able to enable find my device and navigate to the website where the device is shown on the map.

Steps:
1. Update a flame device to 20150908030224.
2. Enable data or wifi.
3. Go to settings > find my device.
4. Proceed through setup by supplying account credentials.
5. Enable find my device

Actual Result:
Test fails.

Expected Result:
Test completes successfully.

Traceback (most recent call last):
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace@2/.env/lib/python2.7/site-packages/marionette_client-0.17-py2.7.egg/marionette/marionette_test.py", line 296, in run
testMethod()
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace@2/tests/python/gaia-ui-tests/gaiatest/tests/functional/settings/test_findmydevice.py", line 32, in test_findmydevice
findmydevice.wait_for_enable_switch_to_be_turned_on()
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace@2/tests/python/gaia-ui-tests/gaiatest/apps/settings/regions/findmydevice.py", line 30, in wait_for_enable_switch_to_be_turned_on
expected.element_present(*self._checkbox_locator))
File "/var/lib/jenkins/jobs/flame-kk.ui.adhoc.bitbar/workspace@2/.env/lib/python2.7/site-packages/marionette_driver-0.13-py2.7.egg/marionette_driver/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 61.5 seconds

Comment 1

[Martijn Wargers (dead)]

Looks like this was caused by the pull request in bug 1202162.

Bug 1202162, comment 0 says this is in preparation of moving to web components, so as soon as that happens, this test should pass again.
Kevin, in which bug are you working on the move to web components?

Comment 2

[Martijn Wargers (dead)]

Oh wait, never mind. The pull request in bug 1202162 already has this changed, to use gaia-switch.
I guess in this case, somehow the gaia repo is already updated, but what's on the devices doesn't contain the pull request from bug 1202162 yet.
I think this test will pass the next time.

Comment 3

[Martijn Wargers (dead)]

I guess these mismatches between what's running on the device and what the date the pulled tree is, is inevitable.
This test should be passing at least tomorrow then. Hopefully earlier.
If it still doesn't pass tomorrow, please reopen.

Comment 4

[Nicholas Nelson [:NicholasN]]

This test is failing again, to what I believe is the same issue.

Link to Jenkins report:
http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/410/HTML_Report/

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_client-0.17-py2.7.egg/marionette/marionette_test.py", line 296, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/tests/functional/settings/test_findmydevice.py", line 32, in test_findmydevice
findmydevice.wait_for_enable_switch_to_be_turned_on()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/tests/python/gaia-ui-tests/gaiatest/apps/settings/regions/findmydevice.py", line 27, in wait_for_enable_switch_to_be_turned_on
expected.element_present(*self._findmydevice_locator))
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/.env/local/lib/python2.7/site-packages/marionette_driver-0.13-py2.7.egg/marionette_driver/wait.py", line 143, in until
cause=last_exc)
TimeoutException: TimeoutException: Timed out after 60.4 seconds

Comment 5

[Martijn Wargers (dead)]

Ah, I see Kevin Grandon changed the locator, but he didn't know with gaia-switch usage, we also need to change the way to check for the checked property/attribute. 
But I'll wait on the pull request for bug 1202388 to get merged (that one is waiting on the tree to reopen), so I can make a pull request based on that new API.

Comment 6

[Kevin Grandon :kgrandon]

Sorry about that, thanks for taking care of it. Can we get these tests running on treeherder, per commit?

Comment 7

[GitHub Autolander Bot]

Attachment: [gaia] mwargers:1202831 > mozilla-b2g:master

Comment 8

[Martijn Wargers (dead)]

(In reply to Kevin Grandon :kgrandon from comment #6)
> Sorry about that, thanks for taking care of it. Can we get these tests
> running on treeherder, per commit?

Actually, Gip tests were running on b2g desktop on Treeherder, but were hidden in bug 1180511. But also note bug 1180903, where that was also the plan on doing.
For this case, it wouldn't matter, because this is an external test and wouldn't be able to run in Treeherder anyway (at least not Tier 1)
After that, we still had them working on Treehderder tryserver, but that was also removed in bug 1198728.

I'm thankful that you took the effort of trying to fix the Gaia UI test, Kevin, but currently, we make it very difficult for developers to see if their patches do not break Gaia UI tests. 
We need to improve that situation.

Comment 9

[Johan Lorenzo [:jlorenzo]]

Comment on attachment 8659852 [details] [review]
[gaia] mwargers:1202831 > mozilla-b2g:master

Fine by me.

Comment 10

[No-Jun Park [:njpark]]

Comment on attachment 8659852 [details] [review]
[gaia] mwargers:1202831 > mozilla-b2g:master

LGTM

Comment 11

[Martijn Wargers (dead)]

Merged: https://github.com/mozilla-b2g/gaia/commit/55824f7d929f8e15f5c280afef1f1afef9274d0a