Closed Bug 1936619 Opened 2 months ago Closed 2 months ago

Intermittent /webdriver/tests/classic/perform_actions/navigation.py | test_pointer - assert [201, 201] == [200, 200]

Categories

(Remote Protocol :: Marionette, defect, P5)

Product:
Remote Protocol
Component:
Marionette
Version:
Firefox 135
Type:
defect
Points:
1

Tracking

(firefox-esr115 unaffected, firefox-esr128 unaffected, firefox133 unaffected, firefox134 unaffected, firefox135 fixed)

Status:
RESOLVED FIXED
Milestone:
135 Branch
Tracking Flags:
Tracking Status
firefox-esr115 --- unaffected
firefox-esr128 --- unaffected
firefox133 --- unaffected
firefox134 --- unaffected
firefox135 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: whimboo)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [webdriver:m14], [wptsync upstream])

Attachments

(1 file)

Bug 1936619 - [wdspec] Address pointer navigation rounding isses of mouse target position.
48 bytes, text/x-phabricator-request
Details | Review

Filed by: agoloman [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=486475417&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Sy0PJ-0tQqC8WvAqAffdvg/runs/0/artifacts/public/logs/live_backing.log

task 2024-12-11T16:41:20.038Z] 16:41:20     INFO - TEST-PASS | /webdriver/tests/classic/perform_actions/navigation.py | test_key 
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/classic/perform_actions/navigation.py | test_pointer - assert [201, 201] == [200, 200]
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO - session = <Session b3fb8ecf-67d5-4346-9ba3-b7d55294582d>
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO - inline = <function inline.<locals>.inline at 0x7f323219b040>
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO - mouse_chain = <webdriver.client.ActionSequence object at 0x7f32320af0d0>
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO - 
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -     def test_pointer(session, inline, mouse_chain):
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         session.url = inline(
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             f"""<input onmousedown="window.location = '{inline(PAGE_CONTENT)}'"/>""")
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         input = session.find.css("input", all=False)
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -     
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         mouse_chain \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .pointer_move(x=0, y=0, origin=input) \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .pointer_down(button=0) \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .pointer_up(button=0) \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .pause(1000) \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .pointer_move(x=200, y=200) \
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -             .perform()
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -     
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         assert session.url == inline(PAGE_CONTENT)
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -     
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         events = get_events(session)
[task 2024-12-11T16:41:20.039Z] 16:41:20     INFO -         assert len(events) == 1
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - >       assert events[0] == [200, 200]
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E       assert [201, 201] == [200, 200]
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         At index 0 diff: 201 != 200
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         Full diff:
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E           [
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         -     200,
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         ?       ^
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         +     201,
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         ?       ^
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         -     200,
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         ?       ^
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         +     201,
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E         ?       ^
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - E           ]
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - 
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - events     = [[201, 201]]
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - inline     = <function inline.<locals>.inline at 0x7f323219b040>
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - input      = <WebElement 9adfaf90-d56c-4b65-b9b9-86c9274e0413>
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - mouse_chain = <webdriver.client.ActionSequence object at 0x7f32320af0d0>
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - session    = <Session b3fb8ecf-67d5-4346-9ba3-b7d55294582d>
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - 
[task 2024-12-11T16:41:20.040Z] 16:41:20     INFO - tests/web-platform/tests/webdriver/tests/classic/perform_actions/navigation.py:65: AssertionError
[task 2024-12-11T16:41:20.041Z] 16:41:20     INFO - TEST-OK | /webdriver/tests/classic/perform_actions/navigation.py | took 11453ms

This is a regression from bug 1922077 that I haven't seen yet. Lets observe the next days how often this failure can be seen.

status-firefox133: --- → unaffected
status-firefox134: --- → unaffected
status-firefox135: --- → affected
status-firefox-esr115: --- → unaffected
status-firefox-esr128: --- → unaffected
Keywords: regression
Regressed by: 1922077
Version: unspecified → Firefox 135

This failed a single time and no more failures since Dec 11th. Lets close as incomplete for now.

Status: NEW → RESOLVED
Closed: 2 months ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=488305881&repo=autoland

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

The failure here happens on Android because of a rounding issue with comparing the target mouse position. We can fix that by using pytest.approx() to allow a successful comparison even with different rounding of x and y coordinates.

Assignee: nobody → hskupin
Status: REOPENED → ASSIGNED
Whiteboard: [webdriver:m14]

This patch updates the pointer navigation tests for both BiDi
and classic WebDriver protocols to handle rounding discrepancies
when asserting mouse target positions.

Points: --- → 1
Pushed by hskupin@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/2d75a55e1b30 [wdspec] Address pointer navigation rounding isses of mouse target position. r=webdriver-reviewers,jdescottes
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/49858 for changes under testing/web-platform/tests
Whiteboard: [webdriver:m14] → [webdriver:m14], [wptsync upstream]

Lets make this bug summary specific to the failure given that I accidentally attached the patch to a single tracking bug.

Summary: Intermittent /webdriver/tests/classic/perform_actions/navigation.py | single tracking bug → Intermittent /webdriver/tests/classic/perform_actions/navigation.py | test_pointer - assert [201, 201] == [200, 200]

https://hg.mozilla.org/mozilla-central/rev/2d75a55e1b30

Status: ASSIGNED → RESOLVED
Closed: 2 months ago → 2 months ago
status-firefox135: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 135 Branch
Upstream PR merged by moz-wptsync-bot
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: