1433297 - Intermittent TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/interaction/element_clear.py | expected OK

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=158506711&repo=mozilla-central

https://queue.taskcluster.net/v1/task/Zu0uaQp0TueAJiS30z5ZBg/runs/0/artifacts/public/test_info//wpt_errorsummary.log

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Why do we repeat this test that many times?

[task 2018-01-25T18:33:17.998Z] 18:33:17     INFO - TEST-START | /webdriver/tests/interaction/element_clear.py
[task 2018-01-25T18:33:18.438Z] 18:33:18     INFO - PID 2867 | 1516905198430	mozrunner::runner	INFO	Running command: "/builds/worker/workspace/build/application/firefox/firefox" "-marionette" "-profile" "/tmp/rust_mozprofile.Q8xkvzvZNRZu"
[task 2018-01-25T18:33:25.006Z] 18:33:25     INFO - PID 2867 | 1516905205004	Marionette	INFO	Listening on port 2828
[task 2018-01-25T18:33:48.041Z] 18:33:48     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/interaction/element_clear.py | expected OK
[task 2018-01-25T18:33:48.041Z] 18:33:48     INFO - TEST-INFO took 30040ms
[task 2018-01-25T18:33:48.160Z] 18:33:48  WARNING - u'runner_teardown': ()
[..]
[task 2018-01-25T18:33:48.721Z] 18:33:48     INFO - TEST-START | /webdriver/tests/interaction/element_clear.py
[task 2018-01-25T18:33:50.299Z] 18:33:50     INFO - PID 3032 | 1516905230273	mozrunner::runner	INFO	Running command: "/builds/worker/workspace/build/application/firefox/firefox" "-marionette" "-profile" "/tmp/rust_mozprofile.xSr43dzXofER"
[task 2018-01-25T18:33:57.692Z] 18:33:57     INFO - PID 3032 | 1516905237682	Marionette	INFO	Listening on port 2828
[task 2018-01-25T18:34:18.772Z] 18:34:18     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/interaction/element_clear.py | expected OK
[task 2018-01-25T18:34:18.773Z] 18:34:18     INFO - TEST-INFO took 30058ms
[task 2018-01-25T18:34:18.904Z] 18:34:18  WARNING - u'runner_teardown': ()

Andreas, did one of your latest additions for element clear increase the runtime for this test?

Comment 2

[Andreas Tolfsen ❲:ato❳]

Recent patches I’ve made to this file has added a lot of test.
When I time it on my reasonbly quick workstation (a ThinkStation)
the running time is 14.23r.  I have no trouble believing it might
easily approach 30r in try.

I will extend the timeout of the test by marking it as a long test.

Comment 3

[Andreas Tolfsen ❲:ato❳]

Attachment: Bug 1433297 - Extend Element Clear test timeout.

Recent patches to this test has added a lot of new tests and
permutations of existing tests.  It is now considered a long test.

Review commit: https://reviewboard.mozilla.org/r/215918/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/215918/

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Comment on attachment 8945820 [details]
Bug 1433297 - Extend Element Clear test timeout.

https://reviewboard.mozilla.org/r/215918/#review221716

::: testing/web-platform/meta/MANIFEST.json:573811
(Diff revision 1)
>    "resource-timing/resource_subframe_self_navigation.html": [
>     "072eb2cd05a0711abc498f4180738aef7d1bf282",
>     "testharness"
>    ],
>    "resource-timing/resource_timing.worker.js": [
> -   "c458be6cb1c70c151761f69b07d92163a30001f5",
> +   "352213c5bc7533afa10003da93dfb399a101c224",

why that uuid change?

::: testing/web-platform/mozilla/meta/MANIFEST.json:1426
(Diff revision 1)
>    "wasm/js/globals.wast.js": [
>     "86b3c907edd8bb3867c5a5aaaebf6066a215b154",
>     "support"
>    ],
>    "wasm/js/harness/index.js": [
> -   "654a29a03543230ddd2db8f8a3398f33233cbf69",
> +   "b1af046bac238e99d0bc73cc89faf3030149340f",

why that uuid change?

Comment 5

[Andreas Tolfsen ❲:ato❳]

Comment on attachment 8945820 [details]
Bug 1433297 - Extend Element Clear test timeout.

https://reviewboard.mozilla.org/r/215918/#review221716

> why that uuid change?

Because it has changed and the previous commit didn’t update the file.

> why that uuid change?

And same.

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Comment on attachment 8945820 [details]
Bug 1433297 - Extend Element Clear test timeout.

https://reviewboard.mozilla.org/r/215918/#review221716

> Because it has changed and the previous commit didn’t update the file.

I wonder how this works without triggering any kind of failure. :/ This is annoying.

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Comment on attachment 8945820 [details]
Bug 1433297 - Extend Element Clear test timeout.

https://reviewboard.mozilla.org/r/215918/#review221730

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8e1fd0821ce8
Extend Element Clear test timeout. r=whimboo

Comment 9

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/8e1fd0821ce8

Comment 10

[Intermittent Failures Robot]

1 failures in 701 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1433297&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 11

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.