1664819 - [wpt-sync] Sync PR 25518 - [Document Policy] Isolate font-display wpt tests

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 25518 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/25518
Details from upstream follow.

b'Charlie Hu <[e-mail]>' wrote:

[Document Policy] Isolate font-display wpt tests

This CL splits font-display tests into smaller individual tests. The
split has following benefits:

• Clear obstable for implementation of violation report deduplication
• Make the tests stricter. Before the test can verify there are
  4 violation reports generated, but cannot tell which 4 cases generate
  violation reports.

Previously there was an attempt on isolating tests into subframes
(https://chromium-review.googlesource.com/c/chromium/src/+/2227863),
but failed due to flaky crash in network cache (crbug.com/1087277).

Bug: 1087277
Change-Id: Ifad35b40d112956fb00fd680b329e539a8762ed9
Reviewed-on: https://chromium-review.googlesource.com/2405916
WPT-Export-Revision: 67acb9ec6319e53b7496065685228a847c7841ac

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=0aca531e09e685bbe84b23a2cbc919a18a23701d

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 13 tests

Status Summary

Firefox

OK : 12
PASS : 4
FAIL : 9

Chrome

OK : 12
PASS : 13

Safari

FAIL : 1
ERROR : 12
NOTRUN: 12

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/document-policy/font-display/report-only-auto.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/report-only-blank.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/report-only-block.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/report-only-swap.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/reporting-auto.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/reporting-blank.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/reporting-block.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/reporting-swap.tentative.html
font-display-late-swap Report Format: FAIL (Chrome: PASS, Safari: NOTRUN)
/document-policy/font-display/override-to-optional.tentative.html: FAIL (Chrome: PASS, Safari: FAIL)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5dc856161111
[wpt PR 25518] - [Document Policy] Isolate font-display wpt tests, a=testonly
https://hg.mozilla.org/integration/autoland/rev/55b5c94fb04c
[wpt PR 25518] - Update wpt metadata, a=testonly

Comment 4

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/5dc856161111
https://hg.mozilla.org/mozilla-central/rev/55b5c94fb04c