Closed Bug 1650390 Opened 4 years ago Closed 4 years ago

[wpt-sync] Sync PR 24435 - [COOP] Make the failed output of reporting tests more stable in order to use expectations

Categories

(Core :: DOM: Core & HTML, task, P4)

Product:
Core
Component:
DOM: Core & HTML
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla80
Tracking Flags:
Tracking Status
firefox80 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 24435 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/24435
Details from upstream follow.

Pâris MEULEMAN <pmeuleman@chromium.org> wrote:

[COOP] Make the failed output of reporting tests more stable in order to use expectations

Make the failed output of Coop reporting tests more stable in order to use expectations

Bug: 1099208
Change-Id: Ib1b516bc03295eb243d2db3c33ee4bc9db8b89df
Reviewed-on: https://chromium-review.googlesource.com/2279819
WPT-Export-Revision: 0d8a413238ccf54a6f6b022339956c7daaf4b95b

Component: web-platform-tests → DOM: Core & HTML
Product: Testing → Core

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 12 tests and 2 subtests

Status Summary

Firefox

OK : 4
PASS : 8
FAIL : 10
TIMEOUT: 16
NOTRUN : 18

Chrome

OK : 3
PASS : 7
FAIL : 9
TIMEOUT: 18
NOTRUN : 19

Safari

OK : 2
PASS : 6
TIMEOUT: 20
NOTRUN : 28

Links

GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-four-reports.https.html
coop reporting test A test with both COOP and COOP report only setup to CROSS_ORIGIN with same-origin-allow-popups; report-to="coop-popup-report-endpoint", require-corp, same-origin; report-to="coop-popup-report-only-endpoint", require-corp: FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-coop-navigated-popup.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Open a popup to a document without COOP, then navigate it to a document with: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-allow-popups-report-to.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with same-origin, require-corp, , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with same-origin-allow-popups; report-to="coop-popup-report-endpoint", require-corp, , : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-unafe-none-report-to.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with same-origin, , , : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-report-to.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with unsafe-none, , , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with unsafe-none; report-to="coop-popup-report-endpoint", , , : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", require-corp, , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with unsafe-none; report-to="coop-popup-report-endpoint", , , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test reporting same origin to CROSS_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
coop reporting test reporting same origin to SAME_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin to SAME_ORIGIN with unsafe-none; report-to="coop-popup-report-endpoint", , , : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
coop reporting test reporting same origin to CROSS_ORIGIN with unsafe-none; report-to="coop-popup-report-endpoint", , , : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-from-unsafe-none.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test Report only tests for an opener without any COOP/COOP report only set to CROSS_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
coop reporting test Report only tests for an opener without any COOP/COOP report only set to SAME_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", : FAIL (Chrome: FAIL, Safari: TIMEOUT)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-same-origin.https.html
coop reporting test reporting same origin with report-to to SAME_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", require-corp: FAIL (Chrome: TIMEOUT, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with , require-corp, same-origin; report-to="coop-popup-report-only-endpoint", : FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/cross-origin-opener-policy/reporting/navigation-reporting/report-only-same-origin-report-to.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", : NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with , , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/cross-origin-opener-policy/reporting/navigation-reporting/reporting-popup-same-origin-coep-report-to.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
verify remaining reports: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", , , : FAIL (Chrome: FAIL, Safari: TIMEOUT)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with , , same-origin; report-to="coop-popup-report-only-endpoint", require-corp: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to CROSS_ORIGIN with same-origin; report-to="coop-popup-report-endpoint", require-corp, , : TIMEOUT (Chrome: TIMEOUT, Safari: NOTRUN)
coop reporting test reporting same origin with report-to to SAME_ORIGIN with , , same-origin; report-to="coop-popup-report-endpoint", require-corp: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/fedb2d29c61e
[wpt PR 24435] - [COOP] Make the failed output of reporting tests more stable in order to use expectations, a=testonly
https://hg.mozilla.org/integration/autoland/rev/c24a64d5075a
[wpt PR 24435] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/fedb2d29c61e
https://hg.mozilla.org/mozilla-central/rev/c24a64d5075a

Status: NEW → RESOLVED
Closed: 4 years ago
status-firefox80: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla80
You need to log in before you can comment on or make changes to this bug.