1749106 - Intermittent /webdriver/tests/new_window/<random> | test_sets_no_window_name - AssertionError: assert None == ''

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=363460245&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RxGKpNRlSni8EphZnFas_g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-01-08T06:21:48.891Z] 06:21:48     INFO - STDOUT: =================================== FAILURES ===================================
[task 2022-01-08T06:21:48.892Z] 06:21:48     INFO - STDOUT: ___________________________ test_sets_no_window_name ___________________________
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: session = <Session 3480388f-907a-424f-a736-f7727655618a>
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:     def test_sets_no_window_name(session):
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:         response = new_window(session, type_hint="window")
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:         value = assert_success(response)
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:         assert value["type"] == "window"
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:     
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT:         session.window_handle = value["handle"]
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: >       assert window_name(session) == ""
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: E       AssertionError: assert None == ''
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: E         +None
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: E         -''
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: response   = <Responsetatus=200 body={"value": {"handle": "c7d9400c-78df-408e-99de-bd23b77cb671", "type": "window"}}>
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: session    = <Session 3480388f-907a-424f-a736-f7727655618a>
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: value      = {'handle': 'c7d9400c-78df-408e-99de-bd23b77cb671', 'type': 'window'}
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/new_window/new_window.py
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: :54: AssertionError
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: =========================== short test summary info ============================
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: FAILED tests/web-platform/tests/webdriver/tests/new_window/new_window.py::test_sets_no_window_name
[task 2022-01-08T06:21:48.908Z] 06:21:48     INFO - STDOUT: ========================= 1 failed, 4 passed in 3.50s ==========================
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - TEST-PASS | /webdriver/tests/new_window/new_window.py | test_payload 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - TEST-PASS | /webdriver/tests/new_window/new_window.py | test_keeps_current_window_handle 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - TEST-PASS | /webdriver/tests/new_window/new_window.py | test_opens_about_blank_in_new_window 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/new_window/new_window.py | test_sets_no_window_name - AssertionError: assert None == ''
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - session = <Session 3480388f-907a-424f-a736-f7727655618a>
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -     def test_sets_no_window_name(session):
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -         response = new_window(session, type_hint="window")
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -         value = assert_success(response)
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -         assert value["type"] == "window"
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -     
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO -         session.window_handle = value["handle"]
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - >       assert window_name(session) == ""
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - E       AssertionError: assert None == ''
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - E         +None
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - E         -''
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - response   = <Responsetatus=200 body={"value": {"handle": "c7d9400c-78df-408e-99de-bd23b77cb671", "type": "window"}}>
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - session    = <Session 3480388f-907a-424f-a736-f7727655618a>
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - value      = {'handle': 'c7d9400c-78df-408e-99de-bd23b77cb671', 'type': 'window'}
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - 
[task 2022-01-08T06:21:48.909Z] 06:21:48     INFO - tests/web-platform/tests/webdriver/tests/new_window/new_window.py:54: AssertionError
[task 2022-01-08T06:21:48.911Z] 06:21:48     INFO - .
[task 2022-01-08T06:21:48.911Z] 06:21:48     INFO - TEST-OK | /webdriver/tests/new_window/new_window.py | took 3557ms
[task 2022-01-08T06:21:49.043Z] 06:21:49     INFO - Closing logging queue
[task 2022-01-08T06:21:49.043Z] 06:21:49     INFO - queue closed
[task 2022-01-08T06:21:49.044Z] 06:21:49     INFO - Starting runner
[task 2022-01-08T06:21:49.482Z] 06:21:49     INFO - PID 461 | 1641622909477	geckodriver	INFO	Listening on 127.0.0.1:49330
[task 2022-01-08T06:21:49.484Z] 06:21:49     INFO - WebDriver HTTP server listening at http://127.0.0.1:49330/
[task 2022-01-08T06:21:49.484Z] 06:21:49     INFO - TEST-START | /webdriver/tests/new_window/user_prompts.py

Comment 1

[Intermittent Failures Robot]

7 failures in 2801 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 4
  • opt: 4
• windows10-64-2004-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1749106&startday=2022-01-03&endday=2022-01-09&tree=all

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

It looks like to be a regression from bug 1739369.

https://treeherder.mozilla.org/logviewer?job_id=363460245&repo=autoland&lineNumber=100437-100445

[task 2022-01-08T06:21:47.314Z] 06:21:47     INFO - PID 32568 | 1641622907311	Marionette	DEBUG	0 -> [0,406,"WebDriver:NewWindow",{"type":"window"}]
[task 2022-01-08T06:21:47.319Z] 06:21:47     INFO - PID 32568 | 1641622907317	Marionette	TRACE	Received observer notification domwindowopened
[task 2022-01-08T06:21:47.324Z] 06:21:47     INFO - PID 32568 | 1641622907322	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2022-01-08T06:21:47.325Z] 06:21:47     INFO - PID 32568 | 1641622907323	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2022-01-08T06:21:47.715Z] 06:21:47     INFO - PID 32568 | 1641622907713	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2022-01-08T06:21:47.751Z] 06:21:47     INFO - PID 32568 | 1641622907749	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2022-01-08T06:21:47.752Z] 06:21:47     INFO - PID 32568 | 1641622907749	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2022-01-08T06:21:47.772Z] 06:21:47     INFO - PID 32568 | 1641622907770	RemoteAgent	TRACE	Initial navigation already completed
[task 2022-01-08T06:21:47.775Z] 06:21:47     INFO - PID 32568 | 1641622907770	Marionette	DEBUG	0 <- [1,406,null,{"handle":"c7d9400c-78df-408e-99de-bd23b77cb671","type":"window"}]
[task 2022-01-08T06:21:47.778Z] 06:21:47     INFO - PID 32568 | 1641622907774	webdriver::server	DEBUG	<- 200 OK {"value":{"handle":"c7d9400c-78df-408e-99de-bd23b77cb671","type":"window"}}
[task 2022-01-08T06:21:47.784Z] 06:21:47     INFO - PID 32568 | 1641622907776	webdriver::server	DEBUG	-> POST /session/3480388f-907a-424f-a736-f7727655618a/window {"handle": "c7d9400c-78df-408e-99de-bd23b77cb671"}
[task 2022-01-08T06:21:47.784Z] 06:21:47     INFO - PID 32568 | 1641622907780	Marionette	DEBUG	0 -> [0,407,"WebDriver:SwitchToWindow",{"handle":"c7d9400c-78df-408e-99de-bd23b77cb671"}]
[task 2022-01-08T06:21:47.791Z] 06:21:47     INFO - PID 32568 | 1641622907788	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2022-01-08T06:21:47.791Z] 06:21:47     INFO - PID 32568 | 1641622907788	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2022-01-08T06:21:47.811Z] 06:21:47     INFO - PID 32568 | 1641622907804	Marionette	DEBUG	0 <- [1,407,null,{"value":null}]
[task 2022-01-08T06:21:47.812Z] 06:21:47     INFO - PID 32568 | 1641622907805	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2022-01-08T06:21:47.813Z] 06:21:47     INFO - PID 32568 | 1641622907807	webdriver::server	DEBUG	-> POST /session/3480388f-907a-424f-a736-f7727655618a/execute/sync {"script": "\n        return window.name;\n        ", "args": []}
[task 2022-01-08T06:21:47.818Z] 06:21:47     INFO - PID 32568 | 1641622907816	Marionette	DEBUG	0 -> [0,408,"WebDriver:ExecuteScript",{"args":[],"script":"\n        return window.name;\n        "}]
[task 2022-01-08T06:21:47.838Z] 06:21:47     INFO - PID 32568 | 1641622907836	Marionette	DEBUG	0 <- [1,408,null,{"value":null}]
[task 2022-01-08T06:21:47.849Z] 06:21:47     INFO - PID 32568 | 1641622907842	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2022-01-08T06:21:47.858Z] 06:21:47     INFO - PID 32568 | 1641622907854	Marionette	TRACE	[73] MarionetteCommands actor created for window id 72
[task 2022-01-08T06:21:47.903Z] 06:21:47     INFO - STDOUT: FAILED

I'll check back later today for results from the weekend.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

As it looks like bug 1747359 will not fix this particular failure, and I will have to spend some time to further investigate why it's failing.

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1739369

Comment 7

[Intermittent Failures Robot]

30 failures in 3060 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 9
• autoland: 15
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-asan-qr: 17
  • opt: 17
• windows10-64-2004-shippable-qr: 3
  • opt: 3
• linux1804-64-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 1
  • opt: 1
• macosx1015-64-qr: 2
  • debug: 2
• windows10-64-2004-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1749106&startday=2022-01-10&endday=2022-01-16&tree=all

Comment 8

[Intermittent Failures Robot]

3 failures in 3444 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1749106&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 9

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.