1926176 - [wpt-sync] Sync PR 48746 - [wpt] Speculatively deflake `css-sizing/keyword-sizes-on-*.html`

Status: RESOLVED FIXED

(Core :: Layout, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 48746 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/48746
Details from upstream follow.

Jonathan Lee <[e-mail]> wrote:

[wpt] Speculatively deflake css-sizing/keyword-sizes-on-*.html

According to 0, tests should use /fonts/ahem.css instead of assuming
Ahem is available as a system font (which is not the case in Chromium's
CI fleet).

https://crrev.com/c/5941209 exposed latent flakiness 1 in this test
because headless_shell, unlike content_shell 2, does not sideload
Ahem with special test-only logic. The flakiness likely arises in slower
hardware or build configurations if Ahem is not loaded before the test
runs. This can be fixed by first waiting for document.fonts.ready to
resolve.

See https://crrev.com/c/5889804 for a similar fix.

Bug: 374675198, 374694820, 336886479
Cq-Include-Trybots: luci.chromium.try:mac11.0-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac11.0.arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac12.0-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac12.0.arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac13-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac13.arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac14-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac14.arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac15-blink-rel
Cq-Include-Trybots: luci.chromium.try:mac15.arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:win11-arm64-blink-rel
Cq-Include-Trybots: luci.chromium.try:win11-blink-rel
Test: Add ?pipe=trickle(d3) to url() in ahem.css
Test: Tests still run as expected on a system without preinstalled Ahem
Change-Id: I9f0d8ba6a3c4910f832bfc94d38a8ae605689e98

Reviewed-on: https://chromium-review.googlesource.com/5943572
WPT-Export-Revision: 4f0f51f3e4d1c8eeee270e060e44ee1aa8c63e3a

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=d0c69d0d76064336fcb9242ac61b060e1347840b

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 63 subtests

Status Summary

Firefox

OK : 2
PASS: 84
FAIL: 42

Chrome

OK : 2
PASS: 114
FAIL: 12

Safari

OK : 2
PASS: 86
FAIL: 40

Links

GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

• /css/css-sizing/keyword-sizes-on-floated-element.html [wpt.fyi]
  • .test 32: FAIL linked bug:Bug 1923406
  • .test 34: FAIL linked bug:Bug 1923406
  • .test 35: FAIL linked bug:Bug 1923406
  • .test 36: FAIL linked bug:Bug 1923406
• /css/css-sizing/keyword-sizes-on-inline-block.html [wpt.fyi]
  • .test 32: FAIL linked bug:Bug 1923927
  • .test 34: FAIL linked bug:Bug 1923927
  • .test 35: FAIL linked bug:Bug 1923927
  • .test 36: FAIL linked bug:Bug 1923927

New Tests That Don't Pass

• /css/css-sizing/keyword-sizes-on-floated-element.html [wpt.fyi]
  • .test 31: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 32: FAIL (Chrome: PASS, Safari: PASS)
  • .test 33: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 34: FAIL (Chrome: PASS, Safari: PASS)
  • .test 35: FAIL (Chrome: PASS, Safari: PASS)
  • .test 36: FAIL (Chrome: PASS, Safari: PASS)
  • .test 46: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 47: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 48: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 49: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 50: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 51: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 52: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 53: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 54: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 58: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 59: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 60: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 61: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 62: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 63: FAIL (Chrome: FAIL, Safari: FAIL)
• /css/css-sizing/keyword-sizes-on-inline-block.html [wpt.fyi]
  • .test 31: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 32: FAIL (Chrome: PASS, Safari: PASS)
  • .test 33: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 34: FAIL (Chrome: PASS, Safari: PASS)
  • .test 35: FAIL (Chrome: PASS, Safari: PASS)
  • .test 36: FAIL (Chrome: PASS, Safari: PASS)
  • .test 46: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 47: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 48: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 49: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 50: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 51: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 52: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 53: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 54: FAIL (Chrome: PASS, Safari: FAIL)
  • .test 58: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 59: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 60: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 61: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 62: FAIL (Chrome: FAIL, Safari: FAIL)
  • .test 63: FAIL (Chrome: FAIL, Safari: FAIL)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bc88726eb506
[wpt PR 48746] - [wpt] Speculatively deflake `css-sizing/keyword-sizes-on-*.html`, a=testonly

Comment 4

[agoloman]

https://hg.mozilla.org/mozilla-central/rev/bc88726eb506