Open Bug 1559494 Opened 3 months ago Updated 28 days ago

Perma [tier2] /html/cross-origin-opener/new_window_null.tentative.html | null document opening popup to http://web-platform.test:8000 with COOP: "same-site" - assert_equals: expected "" but got "null_to_SAME_ORIGIN_same-site"

Categories

(Core :: DOM: Networking, defect, P5)

defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Assigned: junior)

References

(Regression)

Details

(Keywords: intermittent-failure, leave-open, regression, Whiteboard: [stockwell disabled][wptsync upstream][necko-triaged])

Attachments

(2 files)

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=251936853&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/RXbJEKLlQLyzaIi_Qv0NNw/runs/0/artifacts/public/logs/live_backing.log


[task 2019-06-14T19:48:49.521Z] 19:48:49     INFO - TEST-START | /fetch/corb/script-resource-with-json-parser-breaker.tentative.sub.html
[task 2019-06-14T19:48:49.522Z] 19:48:49     INFO - Closing window 2147483673
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - Traceback (most recent call last):
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 624, in _run
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     self.result = True, self.func(self.protocol, self.url, self.timeout)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 738, in do_testharness
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     self.script_resume % format_map, async=True)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 61, in execute_script
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     return method(script, new_sandbox=False, sandbox=None)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 1656, in execute_async_script
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     rv = self._send_message("WebDriver:ExecuteAsyncScript", body, key="value")
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/decorators.py", line 26, in _
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     return func(*args, **kwargs)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 598, in _send_message
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     self._handle_error(err)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 618, in _handle_error
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING -     raise errors.lookup(error)(message, stacktrace=stacktrace)
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - JavascriptException: TypeError: window.__wptrunner_process_next_event is not a function
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - stacktrace:
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - 	@tests/web-platform/tests/tools/wptrunner/wptrunner/executors/executormarionette.py:66:8
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - 	@tests/web-platform/tests/tools/wptrunner/wptrunner/executors/executormarionette.py:67:8
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - 
[task 2019-06-14T19:48:49.719Z] 19:48:49  WARNING - 
[task 2019-06-14T19:48:49.936Z] 19:48:49     INFO - TEST-ERROR | /fetch/corb/script-resource-with-json-parser-breaker.tentative.sub.html | took 412ms
[task 2019-06-14T19:48:50.563Z] 19:48:50     INFO - Closing logging queue
[task 2019-06-14T19:48:50.563Z] 19:48:50     INFO - queue closed
[task 2019-06-14T19:48:50.579Z] 19:48:50     INFO - Setting up ssl
[task 2019-06-14T19:48:50.587Z] 19:48:50     INFO - certutil | 
[task 2019-06-14T19:48:50.607Z] 19:48:50     INFO - certutil | 
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO - certutil | 
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO - Certificate Nickname                                         Trust Attributes
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO - 
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO - web-platform-tests                                           CT,, 
[task 2019-06-14T19:48:50.614Z] 19:48:50     INFO - 
[task 2019-06-14T19:48:52.320Z] 19:48:52     INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-06-14T19:48:53.562Z] 19:48:53     INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_PROCESS_LOG=/tmp/tmpeOJV08pidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --ez use_multiprocess True --es env10 R_LOG_LEVEL=6
[task 2019-06-14T19:48:54.986Z] 19:48:54     INFO - Starting runner

:valentin, can you please take a look?

Flags: needinfo?(valentin.gosu)
Regressed by: 1527314

James, this looks like a WPT testharness error. Any idea why it's happening?

Flags: needinfo?(valentin.gosu) → needinfo?(james)

Nevermind, I just saw that cross-origin-opener failures.
I think the __wptrunner_process_next_event may be a fluke

I think we need to disable cross-origin-opener on non-e10s android.

Flags: needinfo?(james)
Summary: Perma [tier2] /fetch/corb/script-resource-with-json-parser-breaker.tentative.sub.html JavascriptException: TypeError: window.__wptrunner_process_next_event is not a function → Perma [tier2] /html/cross-origin-opener/new_window_null.tentative.html | null document opening popup to http://web-platform.test:8000 with COOP: "same-site" - assert_equals: expected "" but got "null_to_SAME_ORIGIN_same-site"

Hi Valentin, are you working on disabling this?

There are 29 failures in the last 7 days on android-em-7-0-x86 opt and android-em-7-0-x86_64 debug and opt

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=252121659&repo=mozilla-central&lineNumber=4411

[task 2019-06-16T21:15:16.643Z] 21:15:16 INFO - TEST-START | /fetch/corb/style-html-correctly-labeled.sub.html
[task 2019-06-16T21:15:16.646Z] 21:15:16 INFO - Closing window 2147483659
[task 2019-06-16T21:15:17.316Z] 21:15:17 INFO - .
[task 2019-06-16T21:15:17.316Z] 21:15:17 INFO - TEST-OK | /fetch/corb/style-html-correctly-labeled.sub.html | took 670ms
[task 2019-06-16T21:15:17.955Z] 21:15:17 INFO - Closing logging queue
[task 2019-06-16T21:15:17.956Z] 21:15:17 INFO - queue closed
[task 2019-06-16T21:15:17.971Z] 21:15:17 INFO - Setting up ssl
[task 2019-06-16T21:15:17.987Z] 21:15:17 INFO - certutil |
[task 2019-06-16T21:15:18.009Z] 21:15:18 INFO - certutil |
[task 2019-06-16T21:15:18.024Z] 21:15:18 INFO - certutil |
[task 2019-06-16T21:15:18.024Z] 21:15:18 INFO - Certificate Nickname Trust Attributes
[task 2019-06-16T21:15:18.024Z] 21:15:18 INFO - SSL,S/MIME,JAR/XPI
[task 2019-06-16T21:15:18.025Z] 21:15:18 INFO -
[task 2019-06-16T21:15:18.025Z] 21:15:18 INFO - web-platform-tests CT,,
[task 2019-06-16T21:15:18.025Z] 21:15:18 INFO -
[task 2019-06-16T21:15:19.749Z] 21:15:19 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-06-16T21:15:20.990Z] 21:15:20 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_PROCESS_LOG=/tmp/tmpcd6ycHpidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --ez use_multiprocess True --es env10 R_LOG_LEVEL=6
[task 2019-06-16T21:15:22.726Z] 21:15:22 INFO - Starting runner
[task 2019-06-16T21:15:23.099Z] 21:15:23 INFO - TEST-START | /html/cross-origin-opener/new_window_null.tentative.html
[task 2019-06-16T21:15:23.120Z] 21:15:23 INFO - Setting pref browser.tabs.remote.useCrossOriginOpenerPolicy (true)
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO -
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - TEST-PASS | /html/cross-origin-opener/new_window_null.tentative.html | null document opening popup to http://web-platform.test:8000 with COOP: ""
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - TEST-PASS | /html/cross-origin-opener/new_window_null.tentative.html | null document opening popup to http://web-platform.test:8000 with COOP: "jibberish"
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - TEST-UNEXPECTED-FAIL | /html/cross-origin-opener/new_window_null.tentative.html | null document opening popup to http://web-platform.test:8000 with COOP: "same-site" - assert_equals: expected "" but got "null_to_SAME_ORIGIN_same-site"
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - coop_test/bc.onmessage<@http://web-platform.test:8000/html/cross-origin-opener/common.sub.js:9:5
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1594:25
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - Test.prototype.step_func_done/<@http://web-platform.test:8000/resources/testharness.js:1634:32
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - coop_test@http://web-platform.test:8000/html/cross-origin-opener/common.sub.js:13:18
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - run_coop_tests/<@http://web-platform.test:8000/html/cross-origin-opener/common.sub.js:23:5
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1594:25
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - async_test@http://web-platform.test:8000/resources/testharness.js:576:22
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - run_coop_tests@http://web-platform.test:8000/html/cross-origin-opener/common.sub.js:22:4
[task 2019-06-16T21:15:32.115Z] 21:15:32 INFO - @http://web-platform.test:8000/html/cross-origin-opener/new_window_null.tentative.html:36:1

Flags: needinfo?(valentin.gosu)
Pushed by apavel@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/440efb54ea20
disabled new_window_null.tentative.html on android r=jmaher
Keywords: leave-open
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/17476 for changes under testing/web-platform/tests
Whiteboard: [stockwell disabled] → [stockwell disabled][wptsync upstream]
Upstream PR merged

The .ini file was added to the wrong location and so the test is not actually disabled. It belongs under testing/web-platform/meta/html/cross-origin-opener/ instead of testing/web-platform/tests/html/cross-origin-opener.

Flags: needinfo?(apavel)

Thanks Josh, please take a look.

Flags: needinfo?(apavel) → needinfo?(josh)
Pushed by apavel@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/ef772f4c6eec
disable new_window_null.tentative.html on android under the correct path r=jdm
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/17498 for changes under testing/web-platform/tests
Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.
Flags: needinfo?(josh)

I suspect the test fails on Android because we only have one content process, and a cross-process redirect ends up in the same process as before.

Flags: needinfo?(valentin.gosu)

(In reply to PTO until September 9th from comment #21)

I suspect the test fails on Android because we only have one content process, and a cross-process redirect ends up in the same process as before.

Junior, could you take a look? Thanks.

Flags: needinfo?(juhsu)

Yes. Set P5 with coop in android. Might be WORKSFORME given comment 21

Assignee: nobody → juhsu
Flags: needinfo?(juhsu)
Whiteboard: [stockwell disabled][wptsync upstream] → [stockwell disabled][wptsync upstream][necko-triaged]
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/mozilla-inbound/rev/a56991306ec8
[wpt PR 17476] - [Gecko Bug 1559494] disabled new_window_null.tentative.html on android, a=testonly
https://hg.mozilla.org/integration/mozilla-inbound/rev/53bb11307763
[wpt PR 17498] - [Gecko Bug 1559494] disable new_window_null.tentative.html on android under the correct path, a=testonly
You need to log in before you can comment on or make changes to this bug.