Closed Bug 1639273 Opened 4 months ago Closed 4 months ago

[wpt-sync] Sync PR 23694 - Revert "Reorganize COEP + reporting tests"

Categories

(Testing :: web-platform-tests, task, P4)

task

Tracking

(Not tracked)

RESOLVED INVALID

People

(Reporter: mozilla.org, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 23694 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/23694
Details from upstream follow.

sebsg <sebsg@chromium.org> wrote:

Revert "Reorganize COEP + reporting tests"

This reverts commit a1ca8d21cbc280d825c6ced5e55c3d3873861c6e.

Reason for revert: reporting-navigation.https.html fails on Linux
Bug: 1084593

Original change's description:

Reorganize COEP + reporting tests

The COEP reporting feature has two observable effects. User agents send
reports to the network, and web developers can observe reports via
ReportingObserver. We need to have some tests for each way, but we
don't need to have all the test cases for both ways.

As the ReportingObserver way is faster, easier to debug and less flaky,
we would like to test more cases with ReportingObserver. This CL moves
many test cases from reporting.https.html to
reporting-navigation.https.html and
reporting-subresource-corp.https.html, and rename reporting.https.html
to reporting-to-endpoint.https.html. This CL also removes many
duplicated tests (see reporting-subresource-corp.https.html).

Bug: 1052764
Change-Id: I37a567d8cbb6aec79a8426f2f32630c70e4da112
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2208154
Commit-Queue: Yutaka Hirano \<yhirano@chromium.org>
Reviewed-by: Makoto Shimazu \<shimazu@chromium.org>
Cr-Commit-Position: refs/heads/master@{#770058}

TBR=yhirano@chromium.org,shimazu@chromium.org

Change-Id: Ibf7ae594edc9950f389fec00ac0e4ede08b946ed
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 1052764
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2208361
Reviewed-by: sebsg \<sebsg@chromium.org>
Commit-Queue: sebsg \<sebsg@chromium.org>
Cr-Commit-Position: refs/heads/master@{#770138}

Whiteboard: [wptsync downstream] → [wptsync downstream error]
Status: NEW → RESOLVED
Closed: 4 months ago
Resolution: --- → INVALID
Whiteboard: [wptsync downstream error] → [wptsync downstream]
Whiteboard: [wptsync downstream] → [wptsync downstream error]
PR 23694 applied with additional changes from upstream: f597fd3b0f531feeab70f697025bc242361aa444, 9189c2043df0d424d0f9c1689136c45730b35e88
Component: web-platform-tests → DOM: Core & HTML
Product: Testing → Core
Whiteboard: [wptsync downstream error] → [wptsync downstream]
Component: DOM: Core & HTML → web-platform-tests
Product: Core → Testing

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 77 tests

Status Summary

Firefox

OK : 1[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 2[GitHub]
PASS : 8[GitHub] 82[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt]
FAIL : 8[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 15[GitHub]
TIMEOUT: 2
NOTRUN : 1

Chrome

OK : 2
PASS : 8
FAIL : 15
TIMEOUT: 2
NOTRUN : 1

Safari

OK : 2
FAIL : 21
TIMEOUT: 1
ERROR : 1
NOTRUN : 3

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/html/cross-origin-embedder-policy/reporting.https.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
navigation CORP: FAIL (Chrome: FAIL, Safari: FAIL)
subresource CORP in an iframe hosted by a service worker without COEP: FAIL (Chrome: FAIL, Safari: FAIL)
subresource CORP: FAIL (Chrome: FAIL, Safari: FAIL)
CORP for subresource requests initiated from a service worker: FAIL (Chrome: FAIL, Safari: FAIL)
subresource requests initiated from DedicatedWorker controlled by a passthrough service worker: FAIL (Chrome: FAIL, Safari: FAIL)
COEP violation on nested frame navigation: FAIL (Chrome: FAIL, Safari: FAIL)
subresource requests initiated from DedicatedWorker: FAIL (Chrome: FAIL, Safari: FAIL)
/html/cross-origin-embedder-policy/reporting-subresource-corp.https.html
[shared worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[document] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[dedicated worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[dedicated worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[service worker] blocked due to COEP: FAIL (Chrome: FAIL, Safari: NOTRUN)
[document] blocked due to COEP: FAIL (Chrome: FAIL, Safari: FAIL)
[shared worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: FAIL)
[service worker] blocked during redirect: FAIL (Chrome: FAIL, Safari: NOTRUN)
/html/cross-origin-embedder-policy/reporting-navigation.https.html: TIMEOUT (Chrome: TIMEOUT, Safari: OK)
Navigation CORP: TIMEOUT (Chrome: TIMEOUT, Safari: FAIL)
Navigation CORP and about:blank: NOTRUN (Chrome: NOTRUN, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

/html/cross-origin-embedder-policy/reporting.https.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/eb78332a2eeb
[wpt PR 23694] - Revert "Reorganize COEP + reporting tests", a=testonly
https://hg.mozilla.org/integration/autoland/rev/54de8a0a6f6c
[wpt PR 23694] - Update wpt metadata, a=testonly
You need to log in before you can comment on or make changes to this bug.