Perma /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py | expected OK when Gecko 113 merges to Beta on 2023-04-10
Categories
(Remote Protocol :: WebDriver BiDi, defect)
Tracking
(firefox-esr102 unaffected, firefox111 unaffected, firefox112 unaffected, firefox113+ verified)
Tracking | Status | |
---|---|---|
firefox-esr102 | --- | unaffected |
firefox111 | --- | unaffected |
firefox112 | --- | unaffected |
firefox113 | + | verified |
People
(Reporter: SerbanS, Assigned: jdescottes)
References
(Blocks 2 open bugs, Regression)
Details
(Keywords: regression)
Attachments
(1 file)
[task 2023-03-17T11:43:09.465Z] 11:43:09 INFO - TEST-OK | /webdriver/tests/bidi/network/combined/network_events_tentative.py | took 8409ms
[task 2023-03-17T11:43:09.466Z] 11:43:09 INFO - TEST-START | /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py
[task 2023-03-17T11:43:09.522Z] 11:43:09 INFO - STDOUT: ============================= test session starts ==============================
[task 2023-03-17T11:43:09.523Z] 11:43:09 INFO - STDOUT: platform linux -- Python 3.7.5, pytest-7.0.1, pluggy-unknown -- /builds/worker/workspace/build/venv/bin/python
[task 2023-03-17T11:43:09.524Z] 11:43:09 INFO - STDOUT: rootdir: /builds/worker/workspace/build
[task 2023-03-17T11:43:09.525Z] 11:43:09 INFO - STDOUT: plugins: asyncio-0.19.0
[task 2023-03-17T11:43:09.526Z] 11:43:09 INFO - STDOUT: asyncio: mode=strict
[task 2023-03-17T11:43:09.526Z] 11:43:09 INFO - STDOUT: collecting ...
[task 2023-03-17T11:43:09.536Z] 11:43:09 INFO - STDOUT: collected 5 items
[task 2023-03-17T11:43:09.537Z] 11:43:09 INFO - STDOUT: tests/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py::test_cached
[task 2023-03-17T11:43:09.538Z] 11:43:09 INFO - PID 2078 | 1679053389536 webdriver::server DEBUG -> POST /session {"capabilities": {"alwaysMatch": {"moz:firefoxOptions": {"args": ["--profile", "/tmp/tmp8l3v3c33.mozrunner"] ... RASHREPORTER": "1", "MOZ_CRASHREPORTER_SHUTDOWN": "1", "STYLO_THREADS": "1", "RUST_BACKTRACE": "1"}}, "webSocketUrl": true}}}
[task 2023-03-17T11:43:09.538Z] 11:43:09 INFO - PID 2078 | 1679053389537 mozdevice TRACE adb server response was "emulator-5554 device product:sdk_phone_x86_64 model:Android_SDK_built_for_x86_64 device:generic_x86_64 transport_id:2\n"
[task 2023-03-17T11:43:09.539Z] 11:43:09 INFO - PID 2078 | 1679053389537 mozdevice TRACE execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.539Z] 11:43:09 INFO - PID 2078 | 1679053389537 mozdevice TRACE execute_host_command: << []
[task 2023-03-17T11:43:09.539Z] 11:43:09 INFO - PID 2078 | 1679053389537 mozdevice TRACE execute_host_command: >> "shell:id"
[task 2023-03-17T11:43:09.548Z] 11:43:09 INFO - PID 2078 | 1679053389546 mozdevice TRACE execute_host_command: << "uid=0(root) gid=0(root) groups=0(root),1004(input),1007(log),1011(adb),1015(sdcard_rw),1028(sdcard_r),3001(net_bt_admin),3002(net_bt),3003(inet),3006(net_bw_stats),3009(readproc) context=u:r:su:s0\n"
[task 2023-03-17T11:43:09.548Z] 11:43:09 INFO - PID 2078 | 1679053389547 mozdevice TRACE execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.549Z] 11:43:09 INFO - PID 2078 | 1679053389547 mozdevice TRACE execute_host_command: << []
[task 2023-03-17T11:43:09.549Z] 11:43:09 INFO - PID 2078 | 1679053389547 mozdevice TRACE execute_host_command: >> "shell:su 0 id"
[task 2023-03-17T11:43:09.558Z] 11:43:09 INFO - PID 2078 | 1679053389557 mozdevice TRACE execute_host_command: << "uid=0(root) gid=0(root) groups=0(root),1004(input),1007(log),1011(adb),1015(sdcard_rw),1028(sdcard_r),3001(net_bt_admin),3002(net_bt),3003(inet),3006(net_bw_stats),3009(readproc) context=u:r:su:s0\n"
[task 2023-03-17T11:43:09.559Z] 11:43:09 INFO - PID 2078 | 1679053389557 mozdevice TRACE execute_host_command: >> "host:transport:emulator-5554"
[task 2023-03-17T11:43:09.559Z] 11:43:09 INFO - PID 2078 | 1679053389557 mozdevice TRACE execute_host_command: << []
[task 2023-03-17T11:43:09.560Z] 11:43:09 INFO - PID 2078 | 1679053389557 mozdevice TRACE execute_host_command: >> "shell:su -c id"
[task 2023-03-17T11:43:09.566Z] 11:43:09 INFO - PID 2078 | 1679053389565 mozdevice TRACE execute_host_command: << "su: invalid uid/gid '-c'\n"
[task 2023-03-17T11:43:09.566Z] 11:43:09 INFO - PID 2078 | 1679053389565 mozdevice INFO Device is rooted
<...>
[task 2023-03-17T11:43:16.287Z] 11:43:16 INFO - STDOUT: PASSED
[task 2023-03-17T11:43:16.305Z] 11:43:16 INFO - PID 2078 | 1679053396304 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"implicit": 0}
[task 2023-03-17T11:43:16.313Z] 11:43:16 INFO - PID 2078 | 1679053396312 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.313Z] 11:43:16 INFO - PID 2078 | 1679053396313 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"pageLoad": 300000}
[task 2023-03-17T11:43:16.320Z] 11:43:16 INFO - PID 2078 | 1679053396319 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.321Z] 11:43:16 INFO - PID 2078 | 1679053396320 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/timeouts {"script": 30000}
[task 2023-03-17T11:43:16.327Z] 11:43:16 INFO - PID 2078 | 1679053396326 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.328Z] 11:43:16 INFO - PID 2078 | 1679053396327 webdriver::server DEBUG -> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.338Z] 11:43:16 INFO - PID 2078 | 1679053396337 webdriver::server DEBUG <- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.339Z] 11:43:16 INFO - PID 2078 | 1679053396338 webdriver::server DEBUG -> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.345Z] 11:43:16 INFO - PID 2078 | 1679053396345 webdriver::server DEBUG <- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.346Z] 11:43:16 INFO - PID 2078 | 1679053396345 webdriver::server DEBUG -> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window/handles
[task 2023-03-17T11:43:16.354Z] 11:43:16 INFO - PID 2078 | 1679053396353 webdriver::server DEBUG <- 200 OK {"value":["1df2378a-43da-49c9-9d2b-9713a6122b0d"]}
[task 2023-03-17T11:43:16.355Z] 11:43:16 INFO - PID 2078 | 1679053396354 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.364Z] 11:43:16 INFO - PID 2078 | 1679053396363 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.364Z] 11:43:16 INFO - PID 2078 | 1679053396364 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/alert/dismiss {}
[task 2023-03-17T11:43:16.372Z] 11:43:16 INFO - PID 2078 | 1679053396371 webdriver::server DEBUG <- 404 Not Found {"value":{"error":"no such alert","message":"","stacktrace":"RemoteError@chrome://remote/content/shared/Remo ... ontent/marionette/server.sys.mjs:249:9\n_onJSONObjectReady/<@chrome://remote/content/marionette/transport.sys.mjs:496:20\n"}}
[task 2023-03-17T11:43:16.373Z] 11:43:16 INFO - PID 2078 | 1679053396372 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.382Z] 11:43:16 INFO - PID 2078 | 1679053396381 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.382Z] 11:43:16 INFO - PID 2078 | 1679053396382 webdriver::server DEBUG -> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window
[task 2023-03-17T11:43:16.391Z] 11:43:16 INFO - PID 2078 | 1679053396390 webdriver::server DEBUG <- 200 OK {"value":"1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.391Z] 11:43:16 INFO - PID 2078 | 1679053396391 webdriver::server DEBUG -> GET /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window/handles
[task 2023-03-17T11:43:16.400Z] 11:43:16 INFO - PID 2078 | 1679053396399 webdriver::server DEBUG <- 200 OK {"value":["1df2378a-43da-49c9-9d2b-9713a6122b0d"]}
[task 2023-03-17T11:43:16.400Z] 11:43:16 INFO - PID 2078 | 1679053396400 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/window {"handle": "1df2378a-43da-49c9-9d2b-9713a6122b0d"}
[task 2023-03-17T11:43:16.411Z] 11:43:16 INFO - PID 2078 | 1679053396410 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.411Z] 11:43:16 INFO - PID 2078 | 1679053396410 webdriver::server DEBUG -> POST /session/f45e72d2-7ea6-476c-9e5a-b9d16b19956d/frame {"id": null}
[task 2023-03-17T11:43:16.429Z] 11:43:16 INFO - PID 2078 | 1679053396429 webdriver::server DEBUG <- 200 OK {"value":null}
[task 2023-03-17T11:43:16.431Z] 11:43:16 INFO - STDOUT: tests/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py::test_cached_revalidate[HEAD]
[task 2023-03-17T11:44:29.466Z] 11:44:29 INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py | expected OK
[task 2023-03-17T11:44:29.466Z] 11:44:29 INFO - TEST-INFO took 80003ms
[task 2023-03-17T11:44:39.514Z] 11:44:39 WARNING - Forcibly terminating runner process
[task 2023-03-17T11:44:39.626Z] 11:44:39 INFO - PID 2702 | 1679053479625 geckodriver INFO Listening on 127.0.0.1:49130
[task 2023-03-17T11:44:39.627Z] 11:44:39 INFO - Starting runner
[task 2023-03-17T11:44:39.913Z] 11:44:39 INFO - TEST-START | /webdriver/tests/bidi/network/response_completed/response_completed_tentative.py
Updated•1 year ago
|
Assignee | ||
Comment 1•1 year ago
|
||
That's probably Bug 1810302 again, with a beta-only + debug-isolated-process only android failure with 304 responses.
If I recall correctly we couldn't even skip the test with the manifest, as it would still try to run and timeout the test suite.
Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.
Assignee | ||
Comment 2•1 year ago
|
||
It seems that doing the GET request alone works fine: https://treeherder.mozilla.org/jobs?repo=try&revision=7c6ad9e3d56620cac601d0b4098c35a609889f10
I will do a few more pushes, but if the issue is only with HEAD/OPTIONS, we could just remove those cases for now.
Comment 3•1 year ago
|
||
(In reply to Julian Descottes [:jdescottes] from comment #1)
Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.
Note that the debug-isolated-process
jobs are for Fission and not sure if all the features that enabled on Nightly are also present for Beta.
Assignee | ||
Comment 4•1 year ago
|
||
Additional try pushes:
- with HEAD only: https://treeherder.mozilla.org/jobs?repo=try&revision=0b21da960dc3a9d198c9cdb9fdfbbb21b888e2a4
- with OPTIONS only: https://treeherder.mozilla.org/jobs?repo=try&revision=789f32bf92abe9cbab21eedb649969d1b1466f14
Both are permafailing, even in isolation, but that means we should be able to keep GET working here.
Assignee | ||
Comment 5•1 year ago
|
||
Should fix the permafailure on Android beta
Updated•1 year ago
|
Comment 6•1 year ago
•
|
||
@Julian, the patch doesn't seem to work in today's beta-sim
L.E. Disregard the above comment. The patch wasn't imported. Tomorrow will be imported for the next round of beta-sim :)
Assignee | ||
Comment 7•1 year ago
•
|
||
(In reply to Sandor Molnar from comment #6)
@Julian, the patch doesn't seem to work in today's beta-sim
Are we sure this includes my patch? The file in the try push linked above seems to miss my patch https://hg.mozilla.org/try/file/199e5ae9972e2208d814d27cf54dce7ecb57d278/testing/web-platform/tests/webdriver/tests/bidi/network/response_completed/response_completed_cached_tentative.py#l148
Edit: didn't see your edited message :)
Assignee | ||
Updated•1 year ago
|
Pushed by jdescottes@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/b5218879860c [wdspec] Remove OPTIONS and HEAD test cases from test_cached_revalidate r=webdriver-reviewers,whimboo
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/39087 for changes under testing/web-platform/tests
Comment 10•1 year ago
|
||
bugherder |
Upstream PR merged by moz-wptsync-bot
Comment 12•1 year ago
|
||
(In reply to Julian Descottes [:jdescottes] from comment #1)
That's probably Bug 1810302 again, with a beta-only + debug-isolated-process only android failure with 304 responses.
If I recall correctly we couldn't even skip the test with the manifest, as it would still try to run and timeout the test suite.Olivia: do you know about any difference between nightly and beta which would explain a different behavior on Android for responses with a 304 status? Note that this only happens on the debug-isolated-process platform.
When looking at bug 1804027, I looked through the prefs and searched for RELEASE_OR_BETA tags in related places and didn't find anything that seemed like it could be having an impact on that bug, which does seem similar to this one. I believe the other one was also happening in regular opt and debug Beta builds of GeckoView without isolated processes too, though.
debug-isolated-process
builds have a lot of issues still - meta bug 1565196. Generally, new issues show up in media issues or the crash reporter, but this could be another unreported issue or symptom. In this build, isolated child processes are enabled in Android, which can be enabled with or without fission too.
Description
•