Closed
Bug 1102931
Opened 10 years ago
Closed 7 years ago
Intermittent test_ftu_with_tour.py TestFtu.test_ftu_with_tour | TimeoutException: TimeoutException: Timed out after 10.1 seconds
Categories
(Firefox OS Graveyard :: Gaia::UI Tests, defect)
Tracking
(b2g-v2.2 fixed, b2g-master fixed)
RESOLVED
WONTFIX
2.2 S4 (23jan)
People
(Reporter: cbook, Assigned: viorela)
References
()
Details
(Keywords: intermittent-failure)
Attachments
(5 files)
52 bytes,
text/plain
|
Bebe
:
review+
RobertC
:
review+
|
Details |
46 bytes,
text/x-github-pull-request
|
Bebe
:
review+
RobertC
:
review+
|
Details | Review |
46 bytes,
text/x-github-pull-request
|
Bebe
:
review+
RobertC
:
review+
|
Details | Review |
46 bytes,
text/x-github-pull-request
|
Bebe
:
review+
|
Details | Review |
46 bytes,
text/x-github-pull-request
|
Bebe
:
review+
|
Details | Review |
b2g_macosx64 mozilla-inbound opt test gaia-ui-test-functional-1
https://treeherder.mozilla.org/ui/logviewer.html#?job_id=4105453&repo=mozilla-inbound
03:09:32 ERROR - TEST-UNEXPECTED-ERROR | test_ftu_with_tour.py TestFtu.test_ftu_with_tour | TimeoutException: TimeoutException: Timed out after 10.1 seconds
03:09:32 INFO - Traceback (most recent call last):
03:09:32 INFO - File "/builds/slave/talos-slave/test/build/venv/lib/python2.7/site-packages/marionette/marionette_test.py", line 267, in run
03:09:32 INFO - testMethod()
03:09:32 INFO - File "/builds/slave/talos-slave/test/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/ftu/test_ftu_with_tour.py", line 29, in test_ftu_with_tour
03:09:32 INFO - self.assertEqual(self.ftu.step1_header_text, "Swipe up and down to browse your apps and bookmarks. Tap and hold an icon to delete, move, or edit it.")
03:09:32 INFO - File "/builds/slave/talos-slave/test/gaia/tests/python/gaia-ui-tests/gaiatest/apps/ftu/app.py", line 382, in step1_header_text
03:09:32 INFO - Wait(self.marionette).until(expected.element_displayed(header))
03:09:32 INFO - File "/builds/slave/talos-slave/test/build/venv/lib/python2.7/site-packages/marionette/wait.py", line 143, in until
03:09:32 INFO - cause=last_exc)
03:09:32 INFO - TEST-INFO took 27407ms
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Assignee | ||
Updated•10 years ago
|
Assignee: nobody → viorela.ioia
Assignee | ||
Updated•10 years ago
|
QA Whiteboard: [fxosqa-auto-s5]
Assignee | ||
Comment 5•10 years ago
|
||
Attachment #8529808 -
Flags: review?(robert.chira)
Attachment #8529808 -
Flags: review?(florin.strugariu)
Updated•10 years ago
|
Attachment #8529808 -
Flags: review?(florin.strugariu) → review+
Comment 6•10 years ago
|
||
Comment on attachment 8529808 [details]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/26530/files
Merged in master:
https://github.com/mozilla-b2g/gaia/commit/7d3f9852e84f7da61245e97bd01519c66086873a
Attachment #8529808 -
Flags: review?(robert.chira) → review+
Comment 7•10 years ago
|
||
I will leave this bug open to see if the issue was fixed.
Comment 8•10 years ago
|
||
Please reopen if this is failing again
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Reporter | ||
Comment 9•10 years ago
|
||
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Assignee | ||
Updated•10 years ago
|
QA Whiteboard: [fxosqa-auto-s5] → [fxosqa-auto-from-s5][fxosqa-auto-s6]
Assignee | ||
Comment 14•10 years ago
|
||
Attachment #8535462 -
Flags: review?(robert.chira)
Attachment #8535462 -
Flags: review?(florin.strugariu)
Updated•10 years ago
|
Attachment #8535462 -
Flags: review?(robert.chira) → review+
Updated•10 years ago
|
Attachment #8535462 -
Flags: review?(florin.strugariu) → review+
Comment 15•10 years ago
|
||
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Assignee | ||
Updated•10 years ago
|
QA Whiteboard: [fxosqa-auto-from-s5][fxosqa-auto-s6] → [fxosqa-auto-from-s5][fxosqa-auto-s7]
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Assignee | ||
Comment 29•10 years ago
|
||
I've been working on finding a suitable fix for this failure, but it was really difficult, as I couldn't reproduce the failure locally, though I ran the test ~500 times on mac.
I opened a PR with a potential fix[1], and I retriggered the job that contains this test several times[2]
I added a time.sleep(1) in [1], in my attempt to fix this intermittency issue. Though the results of the test runs are green, I can't assure that this test won't fail again.
So my question here is: should we try this fix, though it has a sleep, or disable this test on mac?
[1] https://github.com/mozilla-b2g/gaia/pull/26888
[2] https://treeherder.mozilla.org/ui/#/jobs?repo=gaia-try&revision=246437b6c7ad
Flags: needinfo?(gmealer)
Flags: needinfo?(florin.strugariu)
(In reply to Viorela Ioia [:viorela] from comment #29)
> So my question here is: should we try this fix, though it has a sleep, or
> disable this test on mac?
I'm not worried about the sleep, more that we're not sure if/why that would fix it.
This has a much higher than 1:500 repro rate on Treeherder--looks pretty close to 1:1. Were we able to try repro'ing or your fix against the similar environment?
Flags: needinfo?(gmealer)
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment 32•10 years ago
|
||
Restarted the build a few times on mac to check the stability
The sleep looks OK to me fi there is no other option
Flags: needinfo?(florin.strugariu)
Assignee | ||
Comment 33•10 years ago
|
||
I retriggered the job several times on gaia-try, results are looking good: https://treeherder.mozilla.org/ui/#/jobs?repo=gaia-try&revision=4e908e0622f1
Attachment #8547561 -
Flags: review?(robert.chira)
Attachment #8547561 -
Flags: review?(florin.strugariu)
Updated•10 years ago
|
Attachment #8547561 -
Flags: review?(robert.chira) → review+
Updated•10 years ago
|
Attachment #8547561 -
Flags: review?(florin.strugariu) → review+
Comment 34•10 years ago
|
||
Status: REOPENED → RESOLVED
Closed: 10 years ago → 10 years ago
Resolution: --- → FIXED
Assignee | ||
Comment 35•10 years ago
|
||
I had to reopen this bug, as the previous patch didn't fix the issue, though the results in gaia-try were looking good. Bug 1120756 was open, because the issue re-appeared.
As I can't either reproduce the failure locally(using a similar env) or find a suitable fix, I will open a PR to disable this test on mac for now.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Assignee | ||
Comment 36•10 years ago
|
||
PR to disable the test on mac
Attachment #8548858 -
Flags: review?(florin.strugariu)
Comment 37•10 years ago
|
||
Comment on attachment 8548858 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/27382
As we are not running this test on mac can you also revert the changes introduced in the previous pull?
https://github.com/mozilla-b2g/gaia/commit/b59b59792f927956d23f672b35a4e3b35f6a651f#diff-5ec76afef7d24a7fd7a3f5db907687b6R29
Attachment #8548858 -
Flags: review?(florin.strugariu) → review-
Assignee | ||
Comment 38•10 years ago
|
||
Attachment #8548863 -
Flags: review?(florin.strugariu)
Assignee | ||
Updated•10 years ago
|
Attachment #8548858 -
Flags: review- → review?(florin.strugariu)
Updated•10 years ago
|
Attachment #8548863 -
Flags: review?(florin.strugariu) → review+
Comment 39•10 years ago
|
||
Comment 40•10 years ago
|
||
Comment on attachment 8548858 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/27382
all looks ok to me... Geo can you give us the final r? for disabling this test on mac
Attachment #8548858 -
Flags: review?(gmealer)
Attachment #8548858 -
Flags: review?(florin.strugariu)
Attachment #8548858 -
Flags: review+
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment 45•10 years ago
|
||
Comment on attachment 8548858 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/27382
Merging this in as this test is still generating intermitents
Attachment #8548858 -
Flags: review?(gmealer)
Comment 46•10 years ago
|
||
Comment on attachment 8548858 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/27382
https://github.com/mozilla-b2g/gaia/commit/64113001308bd30ac3968f0e4179037dc84fddb1
Assignee | ||
Comment 47•10 years ago
|
||
The test was disabled on mac.
Status: REOPENED → RESOLVED
Closed: 10 years ago → 10 years ago
Resolution: --- → FIXED
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment 50•10 years ago
|
||
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment 52•10 years ago
|
||
Back now that we've switched to TC.
Status: RESOLVED → REOPENED
Flags: needinfo?(kgrandon)
Resolution: FIXED → ---
Comment 53•10 years ago
|
||
Mass clear of needinfo as lots of TC changes have recently been deployed. I am still tracking and working on getting these issues fixed, but will work with the most egregious offenders first. Flag me again if needed.
Updated•10 years ago
|
Flags: needinfo?(kgrandon)
Comment 54•10 years ago
|
||
The robot message is totally unhelpful, this is the real error:
01:20:45 ERROR - TEST-UNEXPECTED-ERROR | test_ftu_with_tour.py TestFtu.test_ftu_with_tour | ScriptTimeoutException: ScriptTimeoutException: timed out
01:20:45 INFO - Traceback (most recent call last):
01:20:45 INFO - File "/home/worker/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 277, in run
01:20:45 INFO - self.setUp()
01:20:45 INFO - File "/home/worker/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/ftu/test_ftu_with_tour.py", line 13, in setUp
01:20:45 INFO - GaiaTestCase.setUp(self)
01:20:45 INFO - File "/home/worker/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 805, in setUp
01:20:45 INFO - self.cleanup_gaia(full_reset=False)
01:20:45 INFO - File "/home/worker/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 888, in cleanup_gaia
01:20:45 INFO - self.data_layer.set_volume(0)
01:20:45 INFO - File "/home/worker/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 257, in set_volume
01:20:45 INFO - self.set_setting('audio.volume.%s' % channel, value)
01:20:45 INFO - File "/home/worker/gaia/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 217, in set_setting
01:20:45 INFO - result = self.marionette.execute_async_script('return GaiaDataLayer.setSetting("%s", %s)' % (name, value), special_powers=True)
01:20:45 INFO - File "/home/worker/build/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line 1489, in execute_async_script
01:20:45 INFO - debug_script=debug_script)
01:20:45 INFO - File "/home/worker/build/venv/local/lib/python2.7/site-packages/marionette_driver/decorators.py", line 36, in _
01:20:45 INFO - return func(*args, **kwargs)
01:20:45 INFO - File "/home/worker/build/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line 716, in _send_message
01:20:45 INFO - self._handle_error(response)
01:20:45 INFO - File "/home/worker/build/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line
That is an error that is completely different than what this bug is about, initially.
I assume TC = Taskcluster? It seems like an error in setup. Is this an issue with taskcluster, perhaps?
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment 57•7 years ago
|
||
Firefox OS is not being worked on
Status: REOPENED → RESOLVED
Closed: 10 years ago → 7 years ago
Resolution: --- → WONTFIX
You need to log in
before you can comment on or make changes to this bug.
Description
•