Closed
Bug 1679705
Opened 3 years ago
Closed 3 years ago
Intermittent /webdriver/tests/get_window_rect/user_prompts.py | <test> - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
Categories
(Remote Protocol :: Marionette, defect, P5)
Remote Protocol
Marionette
Tracking
(firefox-esr78 unaffected, firefox83 unaffected, firefox84 unaffected, firefox85 fixed)
RESOLVED
FIXED
| Tracking | Status | |
|---|---|---|
| firefox-esr78 | --- | unaffected |
| firefox83 | --- | unaffected |
| firefox84 | --- | unaffected |
| firefox85 | --- | fixed |
People
(Reporter: intermittent-bug-filer, Assigned: rmader)
References
(Regression)
Details
(Keywords: assertion, intermittent-failure, regression)
Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=322974903&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/U-ZQCJZkTjeGqbU1kRkHaQ/runs/0/artifacts/public/logs/live_backing.log
[task 2020-11-29T20:16:49.254Z] 20:16:49 INFO - STDOUT: tests/web-platform/tests/webdriver/tests/get_window_rect/user_prompts.py
[task 2020-11-29T20:16:49.255Z] 20:16:49 INFO - STDOUT: :21: in check_user_prompt_closed_without_exception
[task 2020-11-29T20:16:49.255Z] 20:16:49 INFO - STDOUT: assert_success(response, original_rect)
[task 2020-11-29T20:16:49.255Z] 20:16:49 INFO - STDOUT: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2020-11-29T20:16:49.255Z] 20:16:49 INFO - STDOUT: response = <Responsetatus=200 body={"value": {"y": 100, "x": 100, "height": 600, "width": 800}}>
[task 2020-11-29T20:16:49.255Z] 20:16:49 INFO - STDOUT: value = {'height': 1040, 'width': 1280, 'x': 100, 'y': 100}
[task 2020-11-29T20:16:49.256Z] 20:16:49 INFO - STDOUT: def assert_success(response, value=None):
[task 2020-11-29T20:16:49.257Z] 20:16:49 INFO - STDOUT: """
[task 2020-11-29T20:16:49.257Z] 20:16:49 INFO - STDOUT: Verify that the provided webdriver.Response instance described
[task 2020-11-29T20:16:49.258Z] 20:16:49 INFO - STDOUT: a valid success response as defined by `dfn-send-a-response` and
[task 2020-11-29T20:16:49.258Z] 20:16:49 INFO - STDOUT: the provided response value.
[task 2020-11-29T20:16:49.259Z] 20:16:49 INFO - STDOUT:
[task 2020-11-29T20:16:49.261Z] 20:16:49 INFO - STDOUT: :param response: ``webdriver.Response`` instance.
[task 2020-11-29T20:16:49.261Z] 20:16:49 INFO - STDOUT: :param value: Expected value of the response body, if any.
[task 2020-11-29T20:16:49.262Z] 20:16:49 INFO - STDOUT: """
[task 2020-11-29T20:16:49.262Z] 20:16:49 INFO - STDOUT: assert response.status == 200, str(response.error)
[task 2020-11-29T20:16:49.262Z] 20:16:49 INFO - STDOUT:
[task 2020-11-29T20:16:49.264Z] 20:16:49 INFO - STDOUT: if value is not None:
[task 2020-11-29T20:16:49.264Z] 20:16:49 INFO - STDOUT: > assert response.body["value"] == value
[task 2020-11-29T20:16:49.265Z] 20:16:49 INFO - STDOUT: E AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
[task 2020-11-29T20:16:49.265Z] 20:16:49 INFO - STDOUT: E Common items:
[task 2020-11-29T20:16:49.266Z] 20:16:49 INFO - STDOUT: E {u'x': 100, u'y': 100}
[task 2020-11-29T20:16:49.266Z] 20:16:49 INFO - STDOUT: E Differing items:
[task 2020-11-29T20:16:49.266Z] 20:16:49 INFO - STDOUT: E {'width': 800} != {'width': 1280}
[task 2020-11-29T20:16:49.267Z] 20:16:49 INFO - STDOUT: E {'height': 600} != {'height': 1040}
[task 2020-11-29T20:16:49.267Z] 20:16:49 INFO - STDOUT: E Full diff:
[task 2020-11-29T20:16:49.267Z] 20:16:49 INFO - STDOUT: E - {u'height': 600, u'width': 800, u'x': 100, u'y': 100}
[task 2020-11-29T20:16:49.267Z] 20:16:49 INFO - STDOUT: E ? ^ -
[task 2020-11-29T20:16:49.268Z] 20:16:49 INFO - STDOUT: E + {u'height': 1040, u'width': 1280, u'x': 100, u'y': 100}
[task 2020-11-29T20:16:49.268Z] 20:16:49 INFO - STDOUT: E ? ^ + ++
[task 2020-11-29T20:16:49.268Z] 20:16:49 INFO - STDOUT: response = <Responsetatus=200 body={"value": {"y": 100, "x": 100, "height": 600, "width": 800}}>
[task 2020-11-29T20:16:49.270Z] 20:16:49 INFO - STDOUT: value = {'height': 1040, 'width': 1280, 'x': 100, 'y': 100}
[task 2020-11-29T20:16:49.270Z] 20:16:49 INFO - STDOUT: tests/web-platform/tests/webdriver/tests/support/asserts.py
[task 2020-11-29T20:16:49.271Z] 20:16:49 INFO - STDOUT: :72: AssertionError
[task 2020-11-29T20:16:49.272Z] 20:16:49 INFO - STDOUT: =============================== warnings summary ===============================
[task 2020-11-29T20:16:49.272Z] 20:16:49 INFO - STDOUT: <undetermined location>
[task 2020-11-29T20:16:49.273Z] 20:16:49 INFO - STDOUT: Module already imported so cannot be rewritten: tests.support.fixtures
[task 2020-11-29T20:16:49.274Z] 20:16:49 INFO - STDOUT: -- Docs: http://doc.pytest.org/en/latest/warnings.html
[task 2020-11-29T20:16:49.275Z] 20:16:49 INFO - STDOUT: =============== 1 failed, 17 passed, 1 warnings in 45.21 seconds ===============
[task 2020-11-29T20:16:49.277Z] 20:16:49 INFO -
[task 2020-11-29T20:16:49.277Z] 20:16:49 INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/get_window_rect/user_prompts.py | test_accept[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
[task 2020-11-29T20:16:49.278Z] 20:16:49 INFO - check_user_prompt_closed_without_exception = <function check_user_prompt_closed_without_exception at 0x7fe66ab458d0>
[task 2020-11-29T20:16:49.278Z] 20:16:49 INFO - dialog_type = 'alert', retval = None
[task 2020-11-29T20:16:49.279Z] 20:16:49 INFO -
[task 2020-11-29T20:16:49.279Z] 20:16:49 INFO - @pytest.mark.capabilities({"unhandledPromptBehavior": "accept"})
[task 2020-11-29T20:16:49.279Z] 20:16:49 INFO - @pytest.mark.parametrize("dialog_type, retval", [
[task 2020-11-29T20:16:49.279Z] 20:16:49 INFO - ("alert", None),
[task 2020-11-29T20:16:49.280Z] 20:16:49 INFO - ("confirm", True),
[task 2020-11-29T20:16:49.280Z] 20:16:49 INFO - ("prompt", ""),
[task 2020-11-29T20:16:49.280Z] 20:16:49 INFO - ])
[task 2020-11-29T20:16:49.280Z] 20:16:49 INFO - def test_accept(check_user_prompt_closed_without_exception, dialog_type, retval):
[task 2020-11-29T20:16:49.280Z] 20:16:49 INFO - > check_user_prompt_closed_without_exception(dialog_type, retval)
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO -
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO - check_user_prompt_closed_without_exception = <function check_user_prompt_closed_without_exception at 0x7fe66ab458d0>
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO - dialog_type = 'alert'
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO - retval = None
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO -
[task 2020-11-29T20:16:49.281Z] 20:16:49 INFO - tests/web-platform/tests/webdriver/tests/get_window_rect/user_prompts.py:68: ```
|
||
Updated•3 years ago
|
Summary: Intermittent /webdriver/tests/get_window_rect/user_prompts.py | test_accept[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100} → Intermittent /webdriver/tests/get_window_rect/user_prompts.py | test_accept/_and_notify[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
|
|
||
Updated•3 years ago
|
Summary: Intermittent /webdriver/tests/get_window_rect/user_prompts.py | test_accept/_and_notify[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100} → Intermittent /webdriver/tests/get_window_rect/user_prompts.py | test_accept/_and_notify/_default[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
|
||
Updated•3 years ago
|
Summary: Intermittent /webdriver/tests/get_window_rect/user_prompts.py | test_accept/_and_notify/_default[capabilities0-alert-None] - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100} → Intermittent /webdriver/tests/get_window_rect/user_prompts.py | <test> - AssertionError: assert {'height': 60...100, 'y': 100} == {'height': 104...100, 'y': 100}
|
|
||
Comment 1•3 years ago
|
||
Narcis, as it looks like this all started to nearly perma fail on Linux with the landing of the patch on bug 1645528. Shouldn't it be backed out?
status-firefox84:
--- → unaffected
status-firefox85:
--- → affected
Flags: needinfo?(nbeleuzu)
Regressed by: 1645528
| Comment hidden (Intermittent Failures Robot) |
|
|
||
Comment 3•3 years ago
|
||
Backing out the patches on bug 1645528 actually fixed these failures.
Assignee: nobody → robert.mader
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
|
|
||
Updated•3 years ago
|
Flags: needinfo?(nbeleuzu)
|
||
Comment 4•3 years ago
|
||
This bug was fixed by backing out bug 1645528: https://bugzilla.mozilla.org/show_bug.cgi?id=1645528#c54
Backout: https://hg.mozilla.org/integration/autoland/rev/241fe575507a1cf8fd73da87ee34096f929158dd
Assignee: robert.mader → nobody
|
|
||
Updated•3 years ago
|
Assignee: nobody → robert.mader
|
Assignee | |
Comment 5•3 years ago
|
||
Meh, the fail neither reproduces locally nor in another try push I just did: https://treeherder.mozilla.org/jobs?repo=try&revision=f1c1bc32832194d6ac5840e12cbacb2f610c0b87
|
|
Assignee | |
Comment 6•3 years ago
|
||
Henrik, I just did two consecutive try pushes and neither of them failed in this test. The same goes for local test. Could you check again if this was by any chance a false positive?
https://treeherder.mozilla.org/jobs?repo=try&revision=f1c1bc32832194d6ac5840e12cbacb2f610c0b87&selectedTaskRun=LBazwhVZQjyYNY5tuU_uDA.0
https://treeherder.mozilla.org/jobs?repo=try&revision=8d408ff40fa707be6b782eccd5563bfb8271ff4b&selectedTaskRun=BG-qv2xMQWKVEFLrLEYjMw.0
Flags: needinfo?(hskupin)
|
||
Updated•3 years ago
|
status-firefox83:
--- → unaffected
status-firefox-esr78:
--- → unaffected
| Comment hidden (Intermittent Failures Robot) |
|
||
Comment 9•1 year ago
|
||
Moving bug to Remote Protocol::Marionette component per bug 1815831.
Component: geckodriver → Marionette
Product: Testing → Remote Protocol
|
||
Updated•1 year ago
|
Keywords: regression
You need to log in
before you can comment on or make changes to this bug.
Description
•