1734034 - Intermitent - High frequency Linux/Windows /webdriver/tests/element_click/center_point.py | test_entirely_in_view - assert (222, <random>) == (222, 222)

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=353617217&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QP2Gv4PqTXSIk23xbPd51g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-10-04T20:32:11.682Z] 20:32:11     INFO - STDOUT: PASSED
[task 2021-10-04T20:32:11.682Z] 20:32:11     INFO - PID 1578 | 1633379531678	webdriver::server	DEBUG	<- 200 OK {"value":[[5,5]]}
[task 2021-10-04T20:32:11.683Z] 20:32:11     INFO - PID 1578 | 1633379531680	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/timeouts {"implicit": 0}
[task 2021-10-04T20:32:11.683Z] 20:32:11     INFO - PID 1578 | 1633379531680	Marionette	DEBUG	0 -> [0,287,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2021-10-04T20:32:11.683Z] 20:32:11     INFO - PID 1578 | 1633379531680	Marionette	DEBUG	0 <- [1,287,null,{"value":null}]
[task 2021-10-04T20:32:11.683Z] 20:32:11     INFO - PID 1578 | 1633379531680	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.684Z] 20:32:11     INFO - PID 1578 | 1633379531681	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/timeouts {"pageLoad": 300000}
[task 2021-10-04T20:32:11.684Z] 20:32:11     INFO - PID 1578 | 1633379531682	Marionette	DEBUG	0 -> [0,288,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2021-10-04T20:32:11.685Z] 20:32:11     INFO - PID 1578 | 1633379531682	Marionette	DEBUG	0 <- [1,288,null,{"value":null}]
[task 2021-10-04T20:32:11.686Z] 20:32:11     INFO - PID 1578 | 1633379531683	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.686Z] 20:32:11     INFO - PID 1578 | 1633379531685	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/timeouts {"script": 30000}
[task 2021-10-04T20:32:11.687Z] 20:32:11     INFO - PID 1578 | 1633379531686	Marionette	DEBUG	0 -> [0,289,"WebDriver:SetTimeouts",{"script":30000}]
[task 2021-10-04T20:32:11.687Z] 20:32:11     INFO - PID 1578 | 1633379531686	Marionette	DEBUG	0 <- [1,289,null,{"value":null}]
[task 2021-10-04T20:32:11.688Z] 20:32:11     INFO - PID 1578 | 1633379531687	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.689Z] 20:32:11     INFO - PID 1578 | 1633379531688	webdriver::server	DEBUG	-> GET /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window
[task 2021-10-04T20:32:11.690Z] 20:32:11     INFO - PID 1578 | 1633379531688	Marionette	DEBUG	0 -> [0,290,"WebDriver:GetWindowHandle",{}]
[task 2021-10-04T20:32:11.690Z] 20:32:11     INFO - PID 1578 | 1633379531688	Marionette	DEBUG	0 <- [1,290,null,{"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.691Z] 20:32:11     INFO - PID 1578 | 1633379531689	webdriver::server	DEBUG	<- 200 OK {"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.692Z] 20:32:11     INFO - PID 1578 | 1633379531690	webdriver::server	DEBUG	-> GET /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window
[task 2021-10-04T20:32:11.693Z] 20:32:11     INFO - PID 1578 | 1633379531690	Marionette	DEBUG	0 -> [0,291,"WebDriver:GetWindowHandle",{}]
[task 2021-10-04T20:32:11.694Z] 20:32:11     INFO - PID 1578 | 1633379531691	Marionette	DEBUG	0 <- [1,291,null,{"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.695Z] 20:32:11     INFO - PID 1578 | 1633379531691	webdriver::server	DEBUG	<- 200 OK {"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.695Z] 20:32:11     INFO - PID 1578 | 1633379531692	webdriver::server	DEBUG	-> GET /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window/handles
[task 2021-10-04T20:32:11.696Z] 20:32:11     INFO - PID 1578 | 1633379531692	Marionette	DEBUG	0 -> [0,292,"WebDriver:GetWindowHandles",{}]
[task 2021-10-04T20:32:11.697Z] 20:32:11     INFO - PID 1578 | 1633379531693	Marionette	DEBUG	0 <- [1,292,null,["aa70401f-1f91-4c4f-a00d-76f8350c636c"]]
[task 2021-10-04T20:32:11.698Z] 20:32:11     INFO - PID 1578 | 1633379531693	webdriver::server	DEBUG	<- 200 OK {"value":["aa70401f-1f91-4c4f-a00d-76f8350c636c"]}
[task 2021-10-04T20:32:11.698Z] 20:32:11     INFO - PID 1578 | 1633379531694	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window {"handle": "aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.699Z] 20:32:11     INFO - PID 1578 | 1633379531695	Marionette	DEBUG	0 -> [0,293,"WebDriver:SwitchToWindow",{"handle":"aa70401f-1f91-4c4f-a00d-76f8350c636c","name":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.709Z] 20:32:11     INFO - PID 1578 | 1633379531695	Marionette	DEBUG	0 <- [1,293,null,{"value":null}]
[task 2021-10-04T20:32:11.709Z] 20:32:11     INFO - PID 1578 | 1633379531696	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.709Z] 20:32:11     INFO - PID 1578 | 1633379531697	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/alert/dismiss {}
[task 2021-10-04T20:32:11.709Z] 20:32:11     INFO - PID 1578 | 1633379531697	Marionette	DEBUG	0 -> [0,294,"WebDriver:DismissAlert",{}]
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531698	Marionette	DEBUG	0 <- [1,294,{"error":"no such alert","message":"","stacktrace":"WebDriverError@chrome://remote/content/shared/webdriver/Errors.jsm ... ote/content/marionette/server.js:253:9\n_onJSONObjectReady/<@chrome://remote/content/marionette/transport.js:500:20\n"},null]
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531698	webdriver::server	DEBUG	<- 404 Not Found {"value":{"error":"no such alert","message":"","stacktrace":"WebDriverError@chrome://remote/content/shared/webdriver/Errors.jsm:181:5\nNoSuchAlertError@chrome://remote/content/shared/webdriver/Errors.jsm:382:5\nGeckoDriver.prototype._checkIfAlertIsPresent@chrome://remote/content/marionette/driver.js:2496:11\nGeckoDriver.prototype.dismissDialog@chrome://remote/content/marionette/driver.js:2397:8\ndespatch@chrome://remote/content/marionette/server.js:306:40\nexecute@chrome://remote/content/marionette/server.js:279:16\nonPacket/<@chrome://remote/content/marionette/server.js:252:20\nonPacket@chrome://remote/content/marionette/server.js:253:9\n_onJSONObjectReady/<@chrome://remote/content/marionette/transport.js:500:20\n"}}
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531700	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window {"handle": "aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531700	Marionette	DEBUG	0 -> [0,295,"WebDriver:SwitchToWindow",{"handle":"aa70401f-1f91-4c4f-a00d-76f8350c636c","name":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531700	Marionette	DEBUG	0 <- [1,295,null,{"value":null}]
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531701	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531701	webdriver::server	DEBUG	-> GET /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window
[task 2021-10-04T20:32:11.710Z] 20:32:11     INFO - PID 1578 | 1633379531702	Marionette	DEBUG	0 -> [0,296,"WebDriver:GetWindowHandle",{}]
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531702	Marionette	DEBUG	0 <- [1,296,null,{"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531702	webdriver::server	DEBUG	<- 200 OK {"value":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531703	webdriver::server	DEBUG	-> GET /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window/handles
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531703	Marionette	DEBUG	0 -> [0,297,"WebDriver:GetWindowHandles",{}]
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531703	Marionette	DEBUG	0 <- [1,297,null,["aa70401f-1f91-4c4f-a00d-76f8350c636c"]]
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531703	webdriver::server	DEBUG	<- 200 OK {"value":["aa70401f-1f91-4c4f-a00d-76f8350c636c"]}
[task 2021-10-04T20:32:11.711Z] 20:32:11     INFO - PID 1578 | 1633379531704	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window {"handle": "aa70401f-1f91-4c4f-a00d-76f8350c636c"}
[task 2021-10-04T20:32:11.713Z] 20:32:11     INFO - PID 1578 | 1633379531704	Marionette	DEBUG	0 -> [0,298,"WebDriver:SwitchToWindow",{"handle":"aa70401f-1f91-4c4f-a00d-76f8350c636c","name":"aa70401f-1f91-4c4f-a00d-76f8350c636c"}]
[task 2021-10-04T20:32:11.713Z] 20:32:11     INFO - PID 1578 | 1633379531705	Marionette	DEBUG	0 <- [1,298,null,{"value":null}]
[task 2021-10-04T20:32:11.716Z] 20:32:11     INFO - PID 1578 | 1633379531705	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.717Z] 20:32:11     INFO - PID 1578 | 1633379531706	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/window/rect {"width": 800, "height": 600}
[task 2021-10-04T20:32:11.717Z] 20:32:11     INFO - PID 1578 | 1633379531706	Marionette	DEBUG	0 -> [0,299,"WebDriver:SetWindowRect",{"height":600,"width":800}]
[task 2021-10-04T20:32:11.718Z] 20:32:11     INFO - PID 1578 | 1633379531707	Marionette	DEBUG	0 <- [1,299,null,{"x":100,"y":100,"width":800,"height":600}]
[task 2021-10-04T20:32:11.718Z] 20:32:11     INFO - PID 1578 | 1633379531707	webdriver::server	DEBUG	<- 200 OK {"value":{"x":100,"y":100,"width":800,"height":600}}
[task 2021-10-04T20:32:11.718Z] 20:32:11     INFO - PID 1578 | 1633379531708	webdriver::server	DEBUG	-> POST /session/c2f47432-6ae1-426e-960a-7c787ffb5884/frame {"id": null}
[task 2021-10-04T20:32:11.719Z] 20:32:11     INFO - PID 1578 | 1633379531708	Marionette	DEBUG	0 -> [0,300,"WebDriver:SwitchToFrame",{"id":null}]
[task 2021-10-04T20:32:11.719Z] 20:32:11     INFO - PID 1578 | 1633379531709	Marionette	DEBUG	0 <- [1,300,null,{"value":null}]
[task 2021-10-04T20:32:11.720Z] 20:32:11     INFO - PID 1578 | 1633379531709	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT: =================================== FAILURES ===================================
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT: ____________________________ test_entirely_in_view _____________________________
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT: session = <Session c2f47432-6ae1-426e-960a-7c787ffb5884>
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT: inline = <function inline.<locals>.inline at 0x7f4cbc0339d8>
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT:     def test_entirely_in_view(session, inline):
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT:         session.url = square(inline, 444)
[task 2021-10-04T20:32:11.721Z] 20:32:11     INFO - STDOUT:         element = session.find.css("#target", all=False)
[task 2021-10-04T20:32:11.722Z] 20:32:11     INFO - STDOUT:     
[task 2021-10-04T20:32:11.723Z] 20:32:11     INFO - STDOUT:         response = element_click(session, element)
[task 2021-10-04T20:32:11.723Z] 20:32:11     INFO - STDOUT:         assert_success(response)
[task 2021-10-04T20:32:11.724Z] 20:32:11     INFO - STDOUT:     
[task 2021-10-04T20:32:11.725Z] 20:32:11     INFO - STDOUT:         click_point = assert_one_click(session)
[task 2021-10-04T20:32:11.725Z] 20:32:11     INFO - STDOUT: >       assert click_point == (222, 222)
[task 2021-10-04T20:32:11.726Z] 20:32:11     INFO - STDOUT: E       assert (222, 209) == (222, 222)
[task 2021-10-04T20:32:11.727Z] 20:32:11     INFO - STDOUT: E         At index 1 diff: 209 != 222
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: E         Full diff:
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: E         - (222, 222)
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: E         ?        ^^
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: E         + (222, 209)
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: E         ?        ^^
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: click_point = (222, 209)
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: element    = <Element 1a82c927-de5a-4d71-a16c-ac369672830b>
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: inline     = <function inline.<locals>.inline at 0x7f4cbc0339d8>
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: response   = <Responsetatus=200 body={"value": null}>
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: session    = <Session c2f47432-6ae1-426e-960a-7c787ffb5884>
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/element_click/center_point.py
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: :51: AssertionError
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: =========================== short test summary info ============================
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: FAILED tests/web-platform/tests/webdriver/tests/element_click/center_point.py::test_entirely_in_view
[task 2021-10-04T20:32:11.734Z] 20:32:11     INFO - STDOUT: ========================= 1 failed, 10 passed in 3.44s =========================
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO - 
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/element_click/center_point.py | test_entirely_in_view - assert (222, 209) == (222, 222)
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO - session = <Session c2f47432-6ae1-426e-960a-7c787ffb5884>
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO - inline = <function inline.<locals>.inline at 0x7f4cbc0339d8>
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO - 
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO -     def test_entirely_in_view(session, inline):
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO -         session.url = square(inline, 444)
[task 2021-10-04T20:32:11.735Z] 20:32:11     INFO -         element = session.find.css("#target", all=False)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO -     
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO -         response = element_click(session, element)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO -         assert_success(response)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO -     
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO -         click_point = assert_one_click(session)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO - >       assert click_point == (222, 222)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO - E       assert (222, 209) == (222, 222)
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO - E         At index 1 diff: 209 != 222
[task 2021-10-04T20:32:11.736Z] 20:32:11     INFO - E         Full diff:
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - E         - (222, 222)
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - E         ?        ^^
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - E         + (222, 209)
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - E         ?        ^^
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - 
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - click_point = (222, 209)
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - element    = <Element 1a82c927-de5a-4d71-a16c-ac369672830b>
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - inline     = <function inline.<locals>.inline at 0x7f4cbc0339d8>
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - response   = <Responsetatus=200 body={"value": null}>
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - session    = <Session c2f47432-6ae1-426e-960a-7c787ffb5884>
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - 
[task 2021-10-04T20:32:11.737Z] 20:32:11     INFO - tests/web-platform/tests/webdriver/tests/element_click/center_point.py:51: AssertionError

Comment 1

[Intermittent Failures Robot]

49 failures in 676 pushes (0.072 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 49

Platform and build breakdown:

• linux1804-64-qr: 49
  • opt: 49

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-10-04&endday=2021-10-04&tree=all

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Given that this is a perma failure has there been done a backfill yet? It should be clear that some landing regressed this test. Btw. there were no code changes in Marionette or geckodriver, which could have affected this test.

Note that this failure only occurs on Linux, so I would check for window manager like landings.

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The test had been backfilled but only the backfills are affected. Might it depend on a test which gets executed before?

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

As it looks like the tests as run per chunk differs for backfill jobs. Take this as example:

https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&searchStr=linux%2Copt%2Cwdspec&revision=93c734e36aac9ad7db8f7d779683054f2203a431

The failing backfill job runs the tests in center_point.py, but the associated Wd3 job does not. Instead it's part of the Wd2 job.

Also the order of the tests is different. In both cases bubbling.py is run before, but then it differs. So most likely that the order of tests matter here.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Aryx, is there a specific chunking requested by backfill jobs? Where are these defined?

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

It's the same set of the tests like the ones in the task which gets backfilled.

Comment 7

[Intermittent Failures Robot]

53 failures in 3626 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #20 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 49
• try: 4

Platform and build breakdown:

• linux1804-64-qr: 53
  • opt: 53

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #6)

It's the same set of the tests like the ones in the task which gets backfilled.

Where are those defined in Taskcluster, and is it possible to trigger them on try?

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

./mach try fuzzy and passing the test folders as additional arguments should get you the same. Andrew, is that the recommended workflow to get a Try task with the same tests scheduled like an optimized task from autoland?

Comment 10

[Andrew Halberstadt [:ahal]]

Yep!

Comment 11

[Norisz Fay [:noriszfay]]

Started appearing on windows too: https://treeherder.mozilla.org/logviewer?job_id=355747137&repo=autoland&lineNumber=3594

Comment 12

[Intermittent Failures Robot]

21 failures in 605 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21

Platform and build breakdown:

• windows10-32-2004-qr: 21
  • opt: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-10-22&endday=2021-10-22&tree=all

Comment 13

[Intermittent Failures Robot]

21 failures in 3186 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 21

Platform and build breakdown:

• windows10-32-2004-qr: 21
  • opt: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 14

[Release mgmt bot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This shouldn't be fixed. We just didn't get any failures because no backfill jobs were most likely run.

Comment 16

[Intermittent Failures Robot]

6 failures in 2819 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform and build breakdown:

• linux1804-64-qr: 5
  • opt: 5
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-11-22&endday=2021-11-28&tree=all

Comment 17

[Intermittent Failures Robot]

38 failures in 731 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 38

Platform and build breakdown:

• windows10-32-2004-qr: 32
  • opt: 32
• linux1804-64-qr: 4
  • opt: 4
• windows10-64-2004-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-12-08&endday=2021-12-08&tree=all

Comment 18

[Intermittent Failures Robot]

41 failures in 3319 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #27 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 41

Platform and build breakdown:

• linux1804-64-qr: 6
  • opt: 6
• windows10-32-2004-qr: 32
  • opt: 32
• windows10-64-2004-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-12-06&endday=2021-12-12&tree=all

Comment 19

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The test that fails here is:
https://searchfox.org/mozilla-central/rev/4646b826a25d3825cf209db890862b45fa09ffc3/testing/web-platform/tests/webdriver/tests/element_click/center_point.py#43-51

Based on all the test results it's always the y coordinate that is failing here. Inspecting the page that gets loaded it can be seen that both the width and height of the element should be 444 pixels:

https://treeherder.mozilla.org/logviewer?job_id=360547744&repo=autoland&lineNumber=2929

[task 2021-12-08T19:03:07.855Z] 19:03:07 INFO - PID 1370 | 1638990187852 webdriver::server DEBUG -> POST /session/d0fd51cd-81c6-4637-ab03-c48473c1bae4/url {"url": "http://web-platform.test:8000/webdriver/tests/support/inline.py?doc=%3C%21doctype+html%3E%0A%3Cmeta+charset%3DUTF-8%3E%0A%0A++++++++%3Cstyle%3E%0A++++++++body+%7B+margin%3A+0+%7D%0A%0A++++++++div+%7B%0A++++++++++background%3A+blue%3B%0A++++++++++width%3A+444px%3B%0A++++++++++height%3A+444px%3B%0A++++++++%7D%0A++++++++%3C%2Fstyle%3E%0A%0A++++++++%3Cdiv+id%3Dtarget%3E%3C%2Fdiv%3E%0A%0A++++++++%3Cscript%3E%0A++++++++window.clicks+%3D+%5B%5D%3B%0A++++++++let+div+%3D+document.querySelector%28%22div%22%29%3B%0A++++++++div.addEventListener%28%22click%22%2C+function%28e%29+%7B+window.clicks.push%28%5Be.clientX%2C+e.clientY%5D%29+%7D%29%3B%0A++++++++%3C%2Fscript%3E%0A++++++++&mime=text%2Fhtml&charset=UTF-8"}

Comment 20

[Intermittent Failures Robot]

1 failures in 1011 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2021-12-27&endday=2022-01-02&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 2801 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-01-03&endday=2022-01-09&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 3444 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 23

[Intermittent Failures Robot]

4 failures in 3165 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-01-31&endday=2022-02-06&tree=all

Comment 24

[Intermittent Failures Robot]

33 failures in 3711 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #43 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 23
• try: 10

Platform and build breakdown:

• linux1804-64-qr: 16
  • debug: 6
  • opt: 10
• linux1804-64-asan-qr: 17
  • opt: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-02-07&endday=2022-02-13&tree=all

Comment 25

[Intermittent Failures Robot]

34 failures in 627 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 34

Platform and build breakdown:

• linux1804-64-asan-qr: 16
  • opt: 16
• linux1804-64-qr: 13
  • debug: 8
  • opt: 5
• windows10-64-2004-qr: 3
  • debug: 2
  • opt: 1
• windows10-32-2004-qr: 2
  • opt: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-02-17&endday=2022-02-17&tree=all

Comment 26

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 45 failures within the last 7 days:

• 25 failures on Linux 18.04 x64 WebRender asan opt
• 15 failures on Linux 18.04 x64 WebRender opt
• 2 failures on Windows 10 x86 2004 WebRender opt/debug
• 3 failures on Windows 10 x64 2004 WebRender opt/debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=368240850&repo=autoland&lineNumber=3147

[task 2022-02-17T15:19:16.895Z] 15:19:16     INFO - STDOUT: =========================== short test summary info ============================
[task 2022-02-17T15:19:16.895Z] 15:19:16     INFO - STDOUT: FAILED tests/web-platform/tests/webdriver/tests/element_click/center_point.py::test_entirely_in_view
[task 2022-02-17T15:19:16.896Z] 15:19:16     INFO - STDOUT: ========================= 1 failed, 10 passed in 6.97s =========================
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO - 
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/element_click/center_point.py | test_entirely_in_view - assert (222, 211) == (222, 222)
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO - session = <Session b5ed204f-2623-4fb6-9236-76d6b60bcd76>
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO - inline = <function inline.<locals>.inline at 0x7f78eac27b70>
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO - 
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO -     def test_entirely_in_view(session, inline):
[task 2022-02-17T15:19:16.898Z] 15:19:16     INFO -         session.url = square(inline, 444)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -         element = session.find.css("#target", all=False)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -     
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -         response = element_click(session, element)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -         assert_success(response)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -     
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO -         click_point = assert_one_click(session)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - >       assert click_point == (222, 222)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E       assert (222, 211) == (222, 222)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         At index 1 diff: 211 != 222
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         Full diff:
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         - (222, 222)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         ?        ^^
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         + (222, 211)
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - E         ?        ^^
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - 
[task 2022-02-17T15:19:16.899Z] 15:19:16     INFO - click_point = (222, 211)
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - element    = <Element 19de4dd8-4175-4ce4-8b42-9953d9284191>
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - inline     = <function inline.<locals>.inline at 0x7f78eac27b70>
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - response   = <Responsetatus=200 body={"value": null}>
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - session    = <Session b5ed204f-2623-4fb6-9236-76d6b60bcd76>
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - 
[task 2022-02-17T15:19:16.900Z] 15:19:16     INFO - tests/web-platform/tests/webdriver/tests/element_click/center_point.py:51: AssertionError
[task 2022-02-17T15:19:16.904Z] 15:19:16     INFO - ..........
[task 2022-02-17T15:19:16.904Z] 15:19:16     INFO - TEST-OK | /webdriver/tests/element_click/center_point.py | took 7027ms

Comment 27

[Intermittent Failures Robot]

45 failures in 3281 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 45

Platform and build breakdown:

• linux1804-64-asan-qr: 25
  • opt: 25
• linux1804-64-qr: 15
  • debug: 10
  • opt: 5
• windows10-64-2004-qr: 3
  • debug: 2
  • opt: 1
• windows10-32-2004-qr: 2
  • opt: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-02-14&endday=2022-02-20&tree=all

Comment 28

[Intermittent Failures Robot]

13 failures in 2992 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13

Platform and build breakdown:

• linux1804-64-asan-qr: 11
  • opt: 11
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-02-21&endday=2022-02-27&tree=all

Comment 29

[Intermittent Failures Robot]

15 failures in 626 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-04&endday=2022-03-04&tree=all

Comment 30

[Marian-Vasile Laza]

There have been 35 total failures in the last 7 days, recent failure log.
Affected platforms are

• linux1804-64-asan-qr
• linux1804-64-qr

Comment 31

[Intermittent Failures Robot]

40 failures in 3063 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 5
• autoland: 35

Platform and build breakdown:

• linux1804-64-qr: 9
  • opt: 6
  • debug: 3
• linux1804-64-asan-qr: 31
  • opt: 31

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-02-28&endday=2022-03-06&tree=all

Comment 32

[Intermittent Failures Robot]

24 failures in 587 pushes (0.041 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 24

Platform and build breakdown:

• linux1804-64-asan-qr: 22
  • opt: 22
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-09&endday=2022-03-09&tree=all

Comment 33

[Intermittent Failures Robot]

17 failures in 765 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17

Platform and build breakdown:

• linux1804-64-asan-qr: 17
  • opt: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-10&endday=2022-03-10&tree=all

Comment 34

[Marian-Vasile Laza]

There have been 64 total failures in the last 7 days, recent failure log.
Affected platforms are:

• linux1804-64-asan-qr
• linux1804-64-qr

Comment 35

[Intermittent Failures Robot]

64 failures in 2837 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 64

Platform and build breakdown:

• linux1804-64-asan-qr: 61
  • opt: 61
• linux1804-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-07&endday=2022-03-13&tree=all

Comment 36

[Henrik Skupin [:whimboo][⌚️UTC+1]]

So the test fails for the very first test in tests/web-platform/tests/webdriver/tests/element_click/center_point.py. Before this file we only run the tests in tests/web-platform/tests/webdriver/tests/element_click/bubbling.py. For non backfill jobs other test files run as well before.

We may wanna push a try build with these two tests only and adding a screenshot command before the failing line. As such we could examine the result via the logs as uploaded and maybe see if the element is wrongly rendered or if it's us reporting the wrong height. Note that remote.log.truncate should be set to false to see the transferred image.

Julian would you have the bandwidth to investigate this?

Comment 37

[Julian Descottes [:jdescottes]]

Marian-Vasile: Looking at recent failures tracked here, they seem to be regular jobs (ie not backfills), is it fine with you if we rename this Bug to remove "backfill perma". At the moment it seems to be a regular (although high frequency) intermittent.

For the record it's also linux-asan + linux-debug only.

Comment 38

[Marian-Vasile Laza]

Hi, I renamed it, thanks for the info.

Comment 39

[Julian Descottes [:jdescottes]]

We noticed a few things:

1. no failure for 3 days, even though nothing really changed on our side.
2. all failures seem to occur when the chunk contains only a few tests. For instance this job only ran /webdriver/tests/element_click.
3. this test only failed on autoland, never on central, which always runs the full suite

This leads me to believe that this test is unstable when some other test has not been executed before it.
I will try to repro on try by running only /webdriver/tests/element_click

Edit: definitely some issue about running this test in isolation: https://treeherder.mozilla.org/jobs?repo=try&revision=61ee90b0994115dfe3001fa3ac31f87f9e93fed6

Comment 40

[Julian Descottes [:jdescottes]]

The test fails because the element is bigger than the available viewport. It seems that the viewport is even further reduced because of a header to restore tabs from the previous session.

One solution would be to reduce the size of the tested element, although it would be great to avoid that header altogether (and understand why it appears intermittently)

Comment 41

[Julian Descottes [:jdescottes]]

Attachment: image.png

Comment 42

[Julian Descottes [:jdescottes]]

Attachment: Bug 1734034 - [wdspec] Reduce size of clicked element in test_entirely_in_view

On linux the session restore infobar makes the viewport too small to display the target element entirely.
Reduce the size of the element to workaround this issue.

Comment 43

[Julian Descottes [:jdescottes]]

Attachment: Bug 1760259 - [remote] Disable session restore infobar for marionette tests, webplatform tests and geckodriver

Depends on D141443

Comment 44

[Phabricator Automation]

Comment on attachment 9268378 [details]
Bug 1760259 - [remote] Disable session restore infobar for marionette tests, webplatform tests and geckodriver

Revision D141444 was moved to bug 1760259. Setting attachment 9268378 [details] to obsolete.

Comment 45

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/14cc84d896e5
[wdspec] Reduce size of clicked element in test_entirely_in_view r=webdriver-reviewers,whimboo

Comment 46

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/14cc84d896e5

Comment 47

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/33262 for changes under testing/web-platform/tests

Comment 48

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot

Comment 49

[Intermittent Failures Robot]

6 failures in 3304 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform and build breakdown:

• linux1804-64-asan-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-14&endday=2022-03-20&tree=all

Comment 50

[Intermittent Failures Robot]

1 failures in 3341 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1734034&startday=2022-03-21&endday=2022-03-27&tree=all

Comment 51

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.