Closed Bug 1559604 Opened 6 months ago Closed 4 months ago

Intermittent /webdriver/tests/back/back.py | test_null_response_value - setup error

Categories

(Testing :: geckodriver, defect, P5)

Version 3
defect

Tracking

(firefox-esr60 unaffected, firefox-esr68 unaffected, firefox68 unaffected, firefox69 unaffected, firefox70 fixed)

RESOLVED FIXED
mozilla70
Tracking Status
firefox-esr60 --- unaffected
firefox-esr68 --- unaffected
firefox68 --- unaffected
firefox69 --- unaffected
firefox70 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: nupurbaghel)

References

Details

(Keywords: intermittent-failure, regression)

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=252029407&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/NL3kb0cZT7qWMt3EjgcTeg/runs/0/artifacts/public/logs/live_backing.log


11:09:24 INFO - STDOUT: tests\web-platform\tests\tools\webdriver\webdriver\client.py
11:09:24 INFO - STDOUT: :472: UnknownErrorException
11:09:24 INFO - STDOUT: ============================== warnings summary ===============================
11:09:24 INFO - STDOUT: <undetermined location>
11:09:24 INFO - STDOUT: Module already imported so cannot be rewritten: mozlog
11:09:24 INFO - STDOUT: -- Docs: http://doc.pytest.org/en/latest/warnings.html
11:09:24 INFO - STDOUT: =============== 6 passed, 1 warnings, 1 error in 12.02 seconds ================
11:09:24 INFO -
11:09:24 INFO - TEST-UNEXPECTED-ERROR | /webdriver/tests/back/back.py | test_null_response_value - setup error
11:09:24 INFO - capabilities = {}
11:09:24 INFO - configuration = {'capabilities': {'moz:firefoxOptions': {'binary': 'Z:\task_1560588878\build\application\firefox\firefox.exe', 'prefs'...orm.test,xn--lve-6lad.www2.not-web-platform.test,www2.www.not-web-platform.test'}}}, 'host': '127.0.0.1', 'port': 4444}
11:09:24 INFO - request = <SubRequest 'session' for <Function 'test_null_response_value'>>

Somehow geckodriver early returns from waiting for a connection to Marionette:

11:09:12 INFO - PID 748 | 1560596952859 geckodriver::marionette DEBUG Waiting 60s to connect to browser on 127.0.0.1:2828
11:09:13 INFO - PID 748 | [10404, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80520012: file z:/build/build/src/extensions/permissions/nsPermissionManager.cpp, line 2903
11:09:13 INFO - PID 748 | 1560596953963 mozrunner::runner DEBUG Killing process 6912

Given that we already had a couple of those cases, I will file a separate bug for it.

Status: NEW → RESOLVED
Closed: 5 months ago
Resolution: --- → INCOMPLETE

Recent test failures show a problem with setting the window handle:

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=261587293&repo=autoland&lineNumber=1241-1243

[task 2019-08-14T13:32:52.622Z] 13:32:52 INFO - PID 3052 | 1565789572613 webdriver::server DEBUG -> POST /session/603e372e-6731-467f-95ea-7df9e287fc13/window {"handle": "2147483650"}
[task 2019-08-14T13:32:52.623Z] 13:32:52 INFO - PID 3052 | 1565789572614 webdriver::server DEBUG <- 500 Internal Server Error {"value":{"error":"unsupported operation","message":"Operation not supported","stacktrace":""}}

I cannot see why this could be failing directly in geckodriver, but it clearly is returned by geckodriver immediately without any command send sent to Marionette.

Andreas, could this be related to any kind of change Nupur is working on for the Marionette module?

Flags: needinfo?(ato)

WebDriver::SwitchToWindow is not handled by the marionette library yet:
https://searchfox.org/mozilla-central/rev/5912f376ab6a17afcba2b7654586013158ed64b5/testing/geckodriver/src/marionette.rs#1023-1025

But there exists a patch for it that has not yet landed:
https://phabricator.services.mozilla.com/D41518

Flags: needinfo?(ato)

Ah, so all those failures came from a single push to autoland:

https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=2cee544a6859c721ea6abe2f47dd492e80658489&searchStr=wd

That was my patch for removing firefox ui update tests via bug 1573406. As you can see from some of the classified failures it was indeed related to bug 1569100, which landed a couple of changes for the new Marionette module but then got backed-out due perma failures:

https://hg.mozilla.org/integration/autoland/rev/58c2f8a1f33784154f7810c8e00799c6da307696

And that fixed it.

Assignee: nobody → nupurbaghel
Status: REOPENED → RESOLVED
Closed: 5 months ago4 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla70
You need to log in before you can comment on or make changes to this bug.