Closed Bug 1823034 Opened 2 years ago Closed 2 years ago

Perma /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py | expected OK when Gecko 113 merges to Beta on 2023-04-10

Categories

(Remote Protocol :: WebDriver BiDi, defect)

Product:
Remote Protocol
Component:
WebDriver BiDi
Type:
defect

Tracking

(firefox-esr102 unaffected, firefox111 unaffected, firefox112 unaffected, firefox113+ verified)

Status:
VERIFIED FIXED
Milestone:
113 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox111 --- unaffected
firefox112 --- unaffected
firefox113 + verified

People

(Reporter: SerbanS, Assigned: jdescottes)

References

(Blocks 2 open bugs, Regression)

Details

(Keywords: regression)

Attachments

(1 file)

Bug 1823034 - [wdspec] Remove OPTIONS and HEAD test cases from test_cached_revalidate
48 bytes, text/x-phabricator-request
Details | Review

Central-as-beta-simulation

How to run these simulations

Failure log

[task 2023-03-17T11:43:09.465Z] 11:43:09     INFO - TEST-OK | /webdriver/tests/bidi/network/combined/network_events_tentative.py | took 8409ms
[task 2023-03-17T11:43:09.466Z] 11:43:09     INFO - TEST-START | /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py
[task 2023-03-17T11:43:09.522Z] 11:43:09     INFO - STDOUT: ============================= test session starts ==============================
[task 2023-03-17T11:43:09.523Z] 11:43:09     INFO - STDOUT: platform linux -- Python 3.7.5, pytest-7.0.1, pluggy-unknown -- /builds/worker/workspace/build/venv/bin/python
[task 2023-03-17T11:43:09.524Z] 11:43:09     INFO - STDOUT: rootdir: /builds/worker/workspace/build
[task 2023-03-17T11:43:09.525Z] 11:43:09     INFO - STDOUT: plugins: asyncio-0.19.0
[task 2023-03-17T11:43:09.526Z] 11:43:09     INFO - STDOUT: asyncio: mode=strict
[task 2023-03-17T11:43:09.526Z] 11:43:09     INFO - STDOUT: collecting ... 
[task 2023-03-17T11:43:09.536Z] 11:43:09     INFO - STDOUT: collected 5 items
[task 2023-03-17T11:43:09.537Z] 11:43:09     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py::test_cached 
[task 2023-03-17T11:43:09.538Z] 11:43:09     INFO - PID 2078 | 1679053389536	webdriver::server	DEBUG	-> POST /session {"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"args": ["--profile", "/tmp/tmp8l3v3c33.mozrunner"] ... RASHREPORTER": "1", "MOZ_CRASHREPORTER_SHUTDOWN": "1", "STYLO_THREADS": "1", "RUST_BACKTRACE": "1"}}, "webSocketUrl": true}}}
[task 2023-03-17T11:43:09.538Z] 11:43:09     INFO - PID 2078 | 1679053389537	mozdevice	TRACE	adb server response was "emulator-5554          device product:sdk_phone_x86_64 model:Android_SDK_built_for_x86_64 device:generic_x86_64 transport_id:2\n"
[task 2023-03-17T11:43:09.539Z] 11:43:09     INFO - PID 2078 | 1679053389537	mozdevice	TRACE	execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.539Z] 11:43:09     INFO - PID 2078 | 1679053389537	mozdevice	TRACE	execute_host_command: << []
[task 2023-03-17T11:43:09.539Z] 11:43:09     INFO - PID 2078 | 1679053389537	mozdevice	TRACE	execute_host_command: >> "shell:id"
[task 2023-03-17T11:43:09.548Z] 11:43:09     INFO - PID 2078 | 1679053389546	mozdevice	TRACE	execute_host_command: << "uid=0(root) gid=0(root) groups=0(root),1004(input),1007(log),1011(adb),1015(sdcard_rw),1028(sdcard_r),3001(net_bt_admin),3002(net_bt),3003(inet),3006(net_bw_stats),3009(readproc) context=u:r:su:s0\n"
[task 2023-03-17T11:43:09.548Z] 11:43:09     INFO - PID 2078 | 1679053389547	mozdevice	TRACE	execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.549Z] 11:43:09     INFO - PID 2078 | 1679053389547	mozdevice	TRACE	execute_host_command: << []
[task 2023-03-17T11:43:09.549Z] 11:43:09     INFO - PID 2078 | 1679053389547	mozdevice	TRACE	execute_host_command: >> "shell:su 0 id"
[task 2023-03-17T11:43:09.558Z] 11:43:09     INFO - PID 2078 | 1679053389557	mozdevice	TRACE	execute_host_command: << "uid=0(root) gid=0(root) groups=0(root),1004(input),1007(log),1011(adb),1015(sdcard_rw),1028(sdcard_r),3001(net_bt_admin),3002(net_bt),3003(inet),3006(net_bw_stats),3009(readproc) context=u:r:su:s0\n"
[task 2023-03-17T11:43:09.559Z] 11:43:09     INFO - PID 2078 | 1679053389557	mozdevice	TRACE	execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.559Z] 11:43:09     INFO - PID 2078 | 1679053389557	mozdevice	TRACE	execute_host_command: << []
[task 2023-03-17T11:43:09.560Z] 11:43:09     INFO - PID 2078 | 1679053389557	mozdevice	TRACE	execute_host_command: >> "shell:su -c id"
[task 2023-03-17T11:43:09.566Z] 11:43:09     INFO - PID 2078 | 1679053389565	mozdevice	TRACE	execute_host_command: << "su: invalid uid/gid '-c'\n"
[task 2023-03-17T11:43:09.566Z] 11:43:09     INFO - PID 2078 | 1679053389565	mozdevice	INFO	Device is rooted
<...>
[task 2023-03-17T11:43:16.287Z] 11:43:16     INFO - STDOUT: PASSED
[task 2023-03-17T11:43:16.305Z] 11:43:16     INFO - PID 2078 | 1679053396304	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"implicit": 0}
[task 2023-03-17T11:43:16.313Z] 11:43:16     INFO - PID 2078 | 1679053396312	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.313Z] 11:43:16     INFO - PID 2078 | 1679053396313	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"pageLoad": 300000}
[task 2023-03-17T11:43:16.320Z] 11:43:16     INFO - PID 2078 | 1679053396319	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.321Z] 11:43:16     INFO - PID 2078 | 1679053396320	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"script": 30000}
[task 2023-03-17T11:43:16.327Z] 11:43:16     INFO - PID 2078 | 1679053396326	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.328Z] 11:43:16     INFO - PID 2078 | 1679053396327	webdriver::server	DEBUG	-> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.338Z] 11:43:16     INFO - PID 2078 | 1679053396337	webdriver::server	DEBUG	<- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.339Z] 11:43:16     INFO - PID 2078 | 1679053396338	webdriver::server	DEBUG	-> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.345Z] 11:43:16     INFO - PID 2078 | 1679053396345	webdriver::server	DEBUG	<- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.346Z] 11:43:16     INFO - PID 2078 | 1679053396345	webdriver::server	DEBUG	-> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window/handles
[task 2023-03-17T11:43:16.354Z] 11:43:16     INFO - PID 2078 | 1679053396353	webdriver::server	DEBUG	<- 200 OK {"value":["1df2378a-43da-49c9-9d2b-9713a6122b0d"]}
[task 2023-03-17T11:43:16.355Z] 11:43:16     INFO - PID 2078 | 1679053396354	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.364Z] 11:43:16     INFO - PID 2078 | 1679053396363	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.364Z] 11:43:16     INFO - PID 2078 | 1679053396364	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/alert/dismiss {}
[task 2023-03-17T11:43:16.372Z] 11:43:16     INFO - PID 2078 | 1679053396371	webdriver::server	DEBUG	<- 404 Not Found {"value":{"error":"no such alert","message":"","stacktrace":"RemoteError@chrome://remote/content/shared/Remo ... ontent/marionette/server.sys.mjs:249:9\n_onJSONObjectReady/<@chrome://remote/content/marionette/transport.sys.mjs:496:20\n"}}
[task 2023-03-17T11:43:16.373Z] 11:43:16     INFO - PID 2078 | 1679053396372	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.382Z] 11:43:16     INFO - PID 2078 | 1679053396381	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.382Z] 11:43:16     INFO - PID 2078 | 1679053396382	webdriver::server	DEBUG	-> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.391Z] 11:43:16     INFO - PID 2078 | 1679053396390	webdriver::server	DEBUG	<- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.391Z] 11:43:16     INFO - PID 2078 | 1679053396391	webdriver::server	DEBUG	-> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window/handles
[task 2023-03-17T11:43:16.400Z] 11:43:16     INFO - PID 2078 | 1679053396399	webdriver::server	DEBUG	<- 200 OK {"value":["1df2378a-43da-49c9-9d2b-9713a6122b0d"]}
[task 2023-03-17T11:43:16.400Z] 11:43:16     INFO - PID 2078 | 1679053396400	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.411Z] 11:43:16     INFO - PID 2078 | 1679053396410	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.411Z] 11:43:16     INFO - PID 2078 | 1679053396410	webdriver::server	DEBUG	-> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/frame {"id": null}
[task 2023-03-17T11:43:16.429Z] 11:43:16     INFO - PID 2078 | 1679053396429	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2023-03-17T11:43:16.431Z] 11:43:16     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py::test_cached_revalidate[HEAD] 
[task 2023-03-17T11:44:29.466Z] 11:44:29     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py | expected OK
[task 2023-03-17T11:44:29.466Z] 11:44:29     INFO - TEST-INFO took 80003ms
[task 2023-03-17T11:44:39.514Z] 11:44:39  WARNING - Forcibly terminating runner process
[task 2023-03-17T11:44:39.626Z] 11:44:39     INFO - PID 2702 | 1679053479625	geckodriver	INFO	Listening on 127.0.0.1:49130
[task 2023-03-17T11:44:39.627Z] 11:44:39     INFO - Starting runner
[task 2023-03-17T11:44:39.913Z] 11:44:39     INFO - TEST-START | /webdriver/tests/bidi/network/response_completed/response_completed_tentative.py
Flags: needinfo?(jdescottes)

That's probably Bug 1810302 again, with a beta-only + debug-isolated-process only android failure with 304 responses.
If I recall correctly we couldn't even skip the test with the manifest, as it would still try to run and timeout the test suite.

Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.

Flags: needinfo?(jdescottes) → needinfo?(ohall)

It seems that doing the GET request alone works fine: https://treeherder.mozilla.org/jobs?repo=try&revision=7c6ad9e3d56620cac601d0b4098c35a609889f10

I will do a few more pushes, but if the issue is only with HEAD/OPTIONS, we could just remove those cases for now.

(In reply to Julian Descottes [:jdescottes] from comment #1)

Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.

Note that the debug-isolated-process jobs are for Fission and not sure if all the features that enabled on Nightly are also present for Beta.

Blocks: 1790371
See Also: → 1810302

Additional try pushes:

Both are permafailing, even in isolation, but that means we should be able to keep GET working here.

Should fix the permafailure on Android beta

Assignee: nobody → jdescottes
Status: NEW → ASSIGNED
Blocks: 1823407

@Julian, the patch doesn't seem to work in today's beta-sim
L.E. Disregard the above comment. The patch wasn't imported. Tomorrow will be imported for the next round of beta-sim :)

(In reply to Sandor Molnar from comment #6)

@Julian, the patch doesn't seem to work in today's beta-sim

Are we sure this includes my patch? The file in the try push linked above seems to miss my patch https://hg.mozilla.org/try/file/199e5ae9972e2208d814d27cf54dce7ecb57d278/testing/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py#l148

Edit: didn't see your edited message :)

Flags: needinfo?(smolnar)
Flags: needinfo?(smolnar)
Pushed by jdescottes@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/b5218879860c [wdspec] Remove OPTIONS and HEAD test cases from test_cached_revalidate r=webdriver-reviewers,whimboo
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/39087 for changes under testing/web-platform/tests

https://hg.mozilla.org/mozilla-central/rev/b5218879860c

Status: ASSIGNED → RESOLVED
Closed: 2 years ago
status-firefox113: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 113 Branch
Upstream PR merged by moz-wptsync-bot

(In reply to Julian Descottes [:jdescottes] from comment #1)

That's probably Bug 1810302 again, with a beta-only + debug-isolated-process only android failure with 304 responses.
If I recall correctly we couldn't even skip the test with the manifest, as it would still try to run and timeout the test suite.

Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.

When looking at bug 1804027, I looked through the prefs and searched for RELEASE_OR_BETA tags in related places and didn't find anything that seemed like it could be having an impact on that bug, which does seem similar to this one. I believe the other one was also happening in regular opt and debug Beta builds of GeckoView without isolated processes too, though.

debug-isolated-process builds have a lot of issues still - meta bug 1565196. Generally, new issues show up in media issues or the crash reporter, but this could be another unreported issue or symptom. In this build, isolated child processes are enabled in Android, which can be enabled with or without fission too.

Flags: needinfo?(ohall)

Verified fixed in today's central as beta sim

Status: RESOLVED → VERIFIED
status-firefox113: fixed → verified
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: