1506898 - Intermittent /webdriver/tests/set_window_rect/set.py | test_negative_x_y - assert 60 <= 0

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=211425365&repo=try

https://queue.taskcluster.net/v1/task/Ya4hkhEtTByqM7XUaCr74A/runs/0/artifacts/public/logs/live_backing.log

[task 2018-11-13T14:31:30.549Z] 14:31:30     INFO - STDOUT: =============================== warnings summary ===============================
[task 2018-11-13T14:31:30.551Z] 14:31:30     INFO - STDOUT: <undetermined location>
[task 2018-11-13T14:31:30.552Z] 14:31:30     INFO - STDOUT:   Module already imported so cannot be rewritten: mozlog
[task 2018-11-13T14:31:30.552Z] 14:31:30     INFO - STDOUT: -- Docs: http://doc.pytest.org/en/latest/warnings.html
[task 2018-11-13T14:31:30.553Z] 14:31:30     INFO - STDOUT: =============== 1 failed, 69 passed, 1 warnings in 32.94 seconds ===============
[task 2018-11-13T14:31:30.591Z] 14:31:30     INFO - 
[task 2018-11-13T14:31:30.591Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_no_change[rect17] 
[task 2018-11-13T14:31:30.592Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_no_change[rect18] 
[task 2018-11-13T14:31:30.592Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_no_change[rect19] 
[task 2018-11-13T14:31:30.592Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_fully_exit_fullscreen 
[task 2018-11-13T14:31:30.593Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_restore_from_minimized 
[task 2018-11-13T14:31:30.593Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_restore_from_maximized 
[task 2018-11-13T14:31:30.594Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_height_width 
[task 2018-11-13T14:31:30.594Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_height_width_larger_than_max 
[task 2018-11-13T14:31:30.594Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_height_width_as_current 
[task 2018-11-13T14:31:30.595Z] 14:31:30     INFO - TEST-PASS | /webdriver/tests/set_window_rect/set.py | test_x_y 
[task 2018-11-13T14:31:30.595Z] 14:31:30     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/set_window_rect/set.py | test_negative_x_y - assert 60 <= 0
[task 2018-11-13T14:31:30.596Z] 14:31:30     INFO - session = <Session 8549dcd2-1ab8-481a-9908-beb2952f87b6>
[task 2018-11-13T14:31:30.596Z] 14:31:30     INFO - 
[task 2018-11-13T14:31:30.596Z] 14:31:30     INFO -     def test_negative_x_y(session):
[task 2018-11-13T14:31:30.597Z] 14:31:30     INFO -         original = session.window.rect
[task 2018-11-13T14:31:30.597Z] 14:31:30     INFO -     
[task 2018-11-13T14:31:30.598Z] 14:31:30     INFO -         response = set_window_rect(session, {"x": - 8, "y": - 8})
[task 2018-11-13T14:31:30.598Z] 14:31:30     INFO -     
[task 2018-11-13T14:31:30.598Z] 14:31:30     INFO -         os = session.capabilities["platformName"]
[task 2018-11-13T14:31:30.599Z] 14:31:30     INFO -         # certain WMs prohibit windows from being moved off-screen
[task 2018-11-13T14:31:30.599Z] 14:31:30     INFO -         if os == "linux":
[task 2018-11-13T14:31:30.599Z] 14:31:30     INFO -             rect = assert_success(response)
[task 2018-11-13T14:31:30.600Z] 14:31:30     INFO - >           assert rect["x"] <= 0
[task 2018-11-13T14:31:30.600Z] 14:31:30     INFO - E           assert 60 <= 0
[task 2018-11-13T14:31:30.601Z] 14:31:30     INFO - 
[task 2018-11-13T14:31:30.601Z] 14:31:30     INFO - original   = {'height': 600, 'width': 800, 'x': 60, 'y': 60}
[task 2018-11-13T14:31:30.601Z] 14:31:30     INFO - os         = 'linux'
[task 2018-11-13T14:31:30.601Z] 14:31:30     INFO - rect       = {'height': 600, 'width': 800, 'x': 60, 'y': 60}
[task 2018-11-13T14:31:30.602Z] 14:31:30     INFO - response   = <Responsetatus=200 body={"value": {"y": 60, "x": 60, "height": 600, "width": 800}}>
[task 2018-11-13T14:31:30.602Z] 14:31:30     INFO - session    = <Session 8549dcd2-1ab8-481a-9908-beb2952f87b6>
[task 2018-11-13T14:31:30.603Z] 14:31:30     INFO - 
[task 2018-11-13T14:31:30.604Z] 14:31:30     INFO - tests/web-platform/tests/webdriver/tests/set_window_rect/set.py:241: AssertionError
[task 2018-11-13T14:31:30.605Z] 14:31:30     INFO - .......

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The test hasn't been modified for a while. So I assume this is a regression from bug 1492499, whereby it only happened once on try so far. So lets wait for more data.

Comment 2

[Intermittent Failures Robot]

1 failures in 2917 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 3

[Andreas Tolfsen ❲:ato❳]

And notably only on Quantum Renderer.  I’m assuming that is slower
at resizing the window.

Comment 4

[Intermittent Failures Robot]

2 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* try: 1

Platform breakdown:
* linux32-nightly: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 2808 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 6

[Intermittent Failures Robot]

2 failures in 2485 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1
* mozilla-central: 1

Platform breakdown:
* linux32: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-12-10&endday=2018-12-16&tree=all

Comment 7

[Intermittent Failures Robot]

4 failures in 2648 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 2
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* linux64: 3
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-12-17&endday=2018-12-23&tree=all

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+1]]

With some more logging it would be easier to investigate. This will be done via bug 1510940.

Comment 9

[Intermittent Failures Robot]

3 failures in 1668 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* autoland: 2

Platform breakdown:
* linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1506898&startday=2018-12-31&endday=2019-01-06&tree=all

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+1]]

With bug 1478358 landed the "WebDriver:SetWindowRect" command no longer uses a timed promise to wait for a resize event. I also can no longer see this failure classified via Treeherder. So it should hopefully be fixed.

Comment 11

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.