2054426 - [wpt-sync] Sync PR 61246 - Move Early hints tests to a popup model

Status: RESOLVED FIXED

(Core :: Networking: HTTP, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 61246 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/61246
Details from upstream follow.

Yoav Weiss <[e-mail]> wrote:

Move Early hints tests to a popup model

When trying to import the Early Hints WPTs to Safari, I saw a lot of flakiness, especially in WebKit's "stress mode" test runner. It seems that the flakiness were coming from the use of location.replace.
This PR changes the model for EarlyHints test and have them use a popup window, while fetching the test results from that window. This seems like a potentially more stable model.

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=0bc087e87c8466dd5d9e0c8aae80c14e71210296

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, and Chrome on GitHub CI

Total 47 tests and 1 subtests

Status Summary

Firefox

OK : 45
PASS : 43
FAIL : 5
TIMEOUT: 4

Chrome

OK : 47
PASS : 49
FAIL : 1

Links

GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /loading/early-hints/coep-early-hints-none-final-require-corp.h2.window.html [wpt.fyi]
  • Early Hints COEP mismatch: Early Hints policy = unsafe-none, final response policy = require-corp.: FAIL (Chrome: PASS)
• /loading/early-hints/coep-early-hints-require-corp-final-none.h2.window.html [wpt.fyi]
  • Early Hints COEP mismatch: Early Hints policy = require-corp, final response policy = unsafe-none.: FAIL (Chrome: PASS)
• /loading/early-hints/iframe-pdf.h2.window.html [wpt.fyi]
  • Early hints for an iframe of which content is pdf should be ignored.: FAIL (Chrome: PASS)
• /loading/early-hints/preload-with-csp-document-disallow.h2.window.html [wpt.fyi]: TIMEOUT (Chrome: OK)
  • Early hints preload CSP = allowed, document disallowed the preload later.: TIMEOUT (Chrome: PASS)
• /loading/early-hints/preload-without-csp-document-disallow.h2.window.html [wpt.fyi]: TIMEOUT (Chrome: OK)
  • Early hints preload CSP = absent, document disallowed the preload later.: TIMEOUT (Chrome: PASS)
• /loading/early-hints/referrer-policy-unsafe-url.h2.window.html [wpt.fyi]
  • Referrer policy: unsafe-url: FAIL (Chrome: PASS)
• /speculation-rules/speculation-measurement/performance-speculations-multiple-early-hints-preconnect.tentative.h2.window.html [wpt.fyi]
  • Only the first of multiple 103 Early Hints responses contributes preconnects: FAIL (Chrome: PASS)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/efd11679fa31
https://hg.mozilla.org/integration/autoland/rev/9c96d91cf74e
[wpt PR 61246] - Move Early hints tests to a popup model, a=testonly

Comment 4

[Alexandra Borovova [:Sasha]]

Attachment: Bug 2054426 - Do not use "assert_not_equals" to avoid failures in the mozilla specific tests.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/d2085a275376
https://hg.mozilla.org/integration/autoland/rev/8e0a0323608f
Do not use "assert_not_equals" to avoid failures in the mozilla specific tests.

Comment 6

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/61312 for changes under testing/web-platform/tests

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/33a981947c1c
https://hg.mozilla.org/integration/autoland/rev/ed80887c9b73
Revert "Bug 2054426 - Do not use "assert_not_equals" to avoid failures in the mozilla specific tests." for causing wpt failures

Comment 8

[Sandor Molnar[:smolnar]]

Backed out for causing wpt failures

Backout link: https://hg.mozilla.org/integration/autoland/rev/ed80887c9b7357ed05f71ddd5c8afdd962a58b79

Push with failures

Failures log ->TEST-UNEXPECTED-TIMEOUT | /_mozilla/fetch/fetchpriority/fetchpriority-disabled.h2.html

Comment 9

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR was closed without merging

Comment 10

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/9c96d91cf74e
https://hg.mozilla.org/mozilla-central/rev/8e0a0323608f