1639440 - [wpt-sync] Sync PR 23703 - Reland "Reorganize COEP + reporting tests"

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 23703 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/23703
Details from upstream follow.

Yutaka Hirano <[e-mail]> wrote:

Reland "Reorganize COEP + reporting tests"

This reverts commit ba05502857d0f1ed17c092e04a8550fa78bc57f6.

Reason for revert: Relanding with an additional TestExpectations entry.

Original change's description:

Revert "Reorganize COEP + reporting tests"

This reverts commit a1ca8d21cbc280d825c6ced5e55c3d3873861c6e.

Reason for revert: reporting-navigation.https.html fails on Linux
Bug: 1084593

Original change's description:

Reorganize COEP + reporting tests

The COEP reporting feature has two observable effects. User agents send
reports to the network, and web developers can observe reports via
ReportingObserver. We need to have some tests for each way, but we
don't need to have all the test cases for both ways.

As the ReportingObserver way is faster, easier to debug and less flaky,
we would like to test more cases with ReportingObserver. This CL moves
many test cases from reporting.https.html to
reporting-navigation.https.html and
reporting-subresource-corp.https.html, and rename reporting.https.html
to reporting-to-endpoint.https.html. This CL also removes many
duplicated tests (see reporting-subresource-corp.https.html).

Bug: 1052764
Change-Id: I37a567d8cbb6aec79a8426f2f32630c70e4da112
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2208154
Commit-Queue: Yutaka Hirano \<[e-mail]>
Reviewed-by: Makoto Shimazu \<[e-mail]>
Cr-Commit-Position: refs/heads/master@{#770058}

TBR=[e-mail],[e-mail]

Change-Id: Ibf7ae594edc9950f389fec00ac0e4ede08b946ed
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 1052764
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2208361
Reviewed-by: sebsg \<[e-mail]>
Commit-Queue: sebsg \<[e-mail]>
Cr-Commit-Position: refs/heads/master@{#770138}

TBR=[e-mail],[e-mail],[e-mail]

Not skipping CQ checks because this is a reland.

Bug: 1084593, 1052764
Change-Id: Ib6ecf48c10b7d68c7b3d11199c2157417cabe337
Reviewed-on: https://chromium-review.googlesource.com/2208169
WPT-Export-Revision: 52803d60124ed422903afec9428c359ee1fcb5cf

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

PR 23703 applied with additional changes from upstream: f597fd3b0f531feeab70f697025bc242361aa444, 9189c2043df0d424d0f9c1689136c45730b35e88, c06e0a2db19d60dad048649599c5913325b25c3f

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=962c3aeb210e9597783a64b534368b9ae42439bb

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 77 tests

Status Summary

Firefox

OK : 3
PASS : 22[GitHub] 96[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt]
FAIL : 27

Chrome

OK : 3
PASS : 22
FAIL : 27

Safari

OK : 2
FAIL : 41
TIMEOUT: 1
ERROR : 1
NOTRUN : 7

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/html/cross-origin-embedder-policy/reporting-subresource-corp.https.html
[shared worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[document] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[dedicated worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[dedicated worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[service worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: NOTRUN)
[between service worker and page] blocked due to COEP: FAIL (Chrome: FAIL, Safari: NOTRUN)
[document] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[shared worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[between service worker and page] blocked during redirect: FAIL (Chrome: FAIL, Safari: NOTRUN)
[service worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: NOTRUN)
/html/cross-origin-embedder-policy/reporting-to-endpoint.https.html
navigation CORP: FAIL (Chrome: FAIL, Safari: FAIL)
COEP violation on nested frame navigation: FAIL (Chrome: FAIL, Safari: FAIL)
subresource CORP: FAIL (Chrome: FAIL, Safari: FAIL)
/html/cross-origin-embedder-policy/reporting-navigation.https.html
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: |header(cross-origin-embedder-policy,require-corp), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: |header(cross-origin-resource-policy,cross-origin), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-embedder-policy-report-only,require-corp)|header(cross-origin-resource-policy,cross-origin), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: |header(cross-origin-resource-policy,cross-origin), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-embedder-policy,require-corp), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-embedder-policy-report-only,require-corp)|header(cross-origin-resource-policy,cross-origin), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: |header(cross-origin-embedder-policy,require-corp), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-resource-policy,cross-origin), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-resource-policy,cross-origin), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: (none), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: (none), with empty frame: false: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: |header(cross-origin-embedder-policy,require-corp), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy-report-only,require-corp), target: (none), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)
parent: |header(cross-origin-embedder-policy,require-corp), target: (none), with empty frame: true: FAIL (Chrome: FAIL, Safari: FAIL)

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/40ec5636a467
[wpt PR 23703] - Reland "Reorganize COEP + reporting tests", a=testonly
https://hg.mozilla.org/integration/autoland/rev/a7bc7272c10f
[wpt PR 23703] - Update wpt metadata, a=testonly

Comment 5

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/40ec5636a467
https://hg.mozilla.org/mozilla-central/rev/a7bc7272c10f