[wpt-sync] Sync PR 62874 - Reduce WPT flakiness for CSS-based images
Categories
(Core :: Layout, task, P4)
Tracking
()
| Tracking | Status | |
|---|---|---|
| firefox159 | --- | fixed |
People
(Reporter: wpt-sync, Unassigned)
References
(Blocks 1 open bug, )
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 62874 into mozilla-central (this bug is closed when the sync is complete).
PR: https://github.com/web-platform-tests/wpt/pull/62874
Details from upstream follow.
Hoch Hochkeppel <mhochk@microsoft.com> wrote:
Reduce WPT flakiness for CSS-based images
These tests are passing the vast majority of the time, but still failing
with some regularity due to a race between the image being loaded and
the framework capturing the rendered pixels. This change eliminates that
race by adding preloads and explicitly having the test wait for them.An earlier change for page-background-image-print (crrev.com/c/8334591)
found the preload alone was enough to remove the flakiness, but further
investigation into tests failing a greater percentage of the time (e.g.
page-background-005-print) found the preload was only a partial fix, and
corrected my previous misunderstanding that the test harness waited for
preloads automatically.Efforts to fix this broadly at the harness level instead are tracked by
crbug.com/564820079Bug: None
Change-Id: Idfbbcb1d5298072b64f1903f518704f9c00482e5
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/8433968
Reviewed-by: Kurt Catti-Schmidt \<kschmi@microsoft.com>
Commit-Queue: Hoch Hochkeppel \<mhochk@microsoft.com>
Cr-Commit-Position: refs/heads/main@{#1702812}
| Assignee | ||
Updated•2 months ago
|
| Assignee | ||
Comment 1•2 months ago
|
||
Pushed to try (stability) https://treeherder.mozilla.org/jobs?repo=try&landoInstance=lando-prod-2025&landoCommitID=96053
| Assignee | ||
Comment 2•1 month ago
|
||
CI Results
Ran 11 Firefox configurations based on mozilla-central, and Firefox, and Chrome on GitHub CI
Total 258 tests and 15 subtests
Status Summary
Firefox
OK : 22
PASS : 1[GitHub] 9[Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt] 140[Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt] 142[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview] 262[Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-opt] 263[Gecko-linux2404-64-debug, Gecko-windows11-64-25h2-debug]
FAIL : 4[GitHub] 33[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt] 134[Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
TIMEOUT: 2[Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug] 3[Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-opt]
ERROR : 1
Chrome
PASS : 5
Links
Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base
Details
New Tests That Don't Pass
- /css/css-page/crashtests/counter-containment-001.html [wpt.fyi]:
PASS[Gecko-android-em-14-x86_64-debug-geckoview,Gecko-android-em-14-x86_64-lite-opt-geckoview,Gecko-android-em-14-x86_64-opt-geckoview],TIMEOUT[Gecko-linux2204-64-wayland-debug,Gecko-linux2204-64-wayland-opt,Gecko-linux2404-64-debug,Gecko-linux2404-64-opt,Gecko-windows11-32-25h2-debug,Gecko-windows11-32-25h2-opt,Gecko-windows11-64-25h2-debug,Gecko-windows11-64-25h2-opt] - /css/css-page/crashtests/counter-containment-002.html [wpt.fyi]:
PASS[Gecko-android-em-14-x86_64-debug-geckoview,Gecko-android-em-14-x86_64-lite-opt-geckoview,Gecko-android-em-14-x86_64-opt-geckoview],TIMEOUT[Gecko-linux2204-64-wayland-debug,Gecko-linux2204-64-wayland-opt,Gecko-linux2404-64-debug,Gecko-linux2404-64-opt,Gecko-windows11-32-25h2-debug,Gecko-windows11-32-25h2-opt,Gecko-windows11-64-25h2-debug,Gecko-windows11-64-25h2-opt] - /css/css-page/basic-pagination-002-print.html [wpt.fyi]:
FAIL - /css/css-page/basic-pagination-003-print.html [wpt.fyi]:
FAIL - /css/css-page/body-background-slr-print.html [wpt.fyi]:
FAIL - /css/css-page/body-background-srl-print.html [wpt.fyi]:
FAIL - /css/css-page/body-background-vlr-print.html [wpt.fyi]:
FAIL - /css/css-page/body-background-vrl-print.html [wpt.fyi]:
FAIL - /css/css-page/fixedpos-005-print.html [wpt.fyi]:
FAIL - /css/css-page/fixedpos-008-print.html [wpt.fyi]:
FAIL - /css/css-page/fixedpos-010-print.html [wpt.fyi]:
FAIL - /css/css-page/fixedpos-011-print.html [wpt.fyi]:
FAIL - /css/css-page/fixedpos-with-link-with-inline-child-print.html [wpt.fyi]:
FAIL - /css/css-page/media-queries-002-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-013-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-016-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-017-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-018-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-020-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-021-print.html [wpt.fyi]:
FAIL - /css/css-page/monolithic-overflow-023-print.html [wpt.fyi]:
FAIL - /css/css-page/page-background-003-print.html [wpt.fyi]:
FAIL - /css/css-page/page-background-004-print.html [wpt.fyi]:
FAIL - /css/css-page/page-background-005-print.html [wpt.fyi]:
FAIL(Chrome:PASS) - /css/css-page/page-background-image-print.html [wpt.fyi]:
FAIL(Chrome:PASS) - /css/css-page/page-box-000-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-001-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-002-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-003-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-004-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-005-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-006-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-007-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-008-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-009-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-010-print.html [wpt.fyi]:
FAIL - /css/css-page/page-box-011-print.html [wpt.fyi]:
FAIL - /css/css-page/page-left-right-001-print.html [wpt.fyi]:
FAIL - /css/css-page/page-left-right-002-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-001-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-002-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-003-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-005-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-006-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-007-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-auto-and-non-zero-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-auto-negative-print.tentative.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-auto-print.html [wpt.fyi]:
FAIL - /css/css-page/page-margin-negative-print.tentative.html [wpt.fyi]:
FAIL - /css/css-page/page-name-003-print.html [wpt.fyi]:
FAIL - /css/css-page/page-name-and-break-004-print.html [wpt.fyi]:
FAIL - /css/css-page/page-name-table-001-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-001-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-002-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-003-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-009-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-011-print.html [wpt.fyi]:
PASS[Gecko-linux2404-64-debug,Gecko-windows11-64-25h2-debug],TIMEOUT[Gecko-linux2404-64-opt,Gecko-windows11-64-25h2-opt] - /css/css-page/page-size-012-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-013-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-014-print.html [wpt.fyi]:
FAIL - /css/css-page/page-size-016-print.tentative.html [wpt.fyi]:
FAIL - /css/css-page/page-size-017-print.tentative.html [wpt.fyi]:
FAIL - /css/css-page/cssom/dynamic-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/alignment-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/auto-margins-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/auto-margins-002-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/auto-margins-003-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/background-001-print.html [wpt.fyi]:
FAIL(Chrome:PASS) - /css/css-page/margin-boxes/content-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-002-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-003-print.html [wpt.fyi]:
FAIL(Chrome:PASS) - /css/css-page/margin-boxes/content-004-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-005-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-006-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-007-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-008-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-009-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-010-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-011-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-012-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/content-013-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-002-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-003-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-004-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-005-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-006-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-007-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-008-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-009-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-010-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-011-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-012-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-013-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-014-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/dimensions-015-print.tentative.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/inapplicable-properties-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/overconstrained-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/paint-order-001-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/paint-order-002-print.html [wpt.fyi]:
FAIL - /css/css-page/margin-boxes/paint-order-003-print.html [wpt.fyi]:
FAIL - /css/css-page/tentative/safe-printable-inset-001-print.html [wpt.fyi]:
FAIL - /css/css-page/tentative/safe-printable-inset-002-print.html [wpt.fyi]:
FAIL - /css/css-page/tentative/safe-printable-inset-003-print.html [wpt.fyi]:
FAIL - /css/css-page/cssom/margin-001.html [wpt.fyi]
- Rule #1:
FAIL - Rule #2:
FAIL
- Rule #1:
- /css/css-page/cssom/margin-002.html [wpt.fyi]:
ERROR - /css/css-page/cssom/margin-003.html [wpt.fyi]
- Insert rules:
FAIL - Delete rules:
FAIL
- Insert rules:
- /css/css-page/page-orientation.tentative.html [wpt.fyi]
- contents for selector ['named6']:
FAIL
- contents for selector ['named6']:
- /css/css-page/page-rule-declarations-000.html [wpt.fyi]
- unexpected contents for selector [':first']:
FAIL - unexpected contents for selector ['hello']:
FAIL - unexpected contents for selector ['world:right']:
FAIL
- unexpected contents for selector [':first']:
- /css/css-page/page-rule-declarations-001.html [wpt.fyi]
- unexpected contents for selector [':left']:
FAIL - unexpected contents for selector [':right']:
FAIL
- unexpected contents for selector [':left']:
- /css/css-page/page-rule-declarations-004.html [wpt.fyi]
- rule with invalid selector ['--a']:
FAIL - assigning invalid selector text ['--a']:
FAIL
- rule with invalid selector ['--a']:
- /css/css-page/parsing/margin-rules-001.html [wpt.fyi]
- @page { @top-left-corner { } } should be a valid rule:
FAIL - @page { @top-left { } } should be a valid rule:
FAIL - @page { @top-center { } } should be a valid rule:
FAIL - @page { @top-right { } } should be a valid rule:
FAIL - @page { @top-right-corner { } } should be a valid rule:
FAIL - @page { @bottom-left-corner { } } should be a valid rule:
FAIL - @page { @bottom-left { } } should be a valid rule:
FAIL - @page { @bottom-center { } } should be a valid rule:
FAIL - @page { @bottom-right { } } should be a valid rule:
FAIL - @page { @bottom-right-corner { } } should be a valid rule:
FAIL - @page { @left-top { } } should be a valid rule:
FAIL - @page { @left-middle { } } should be a valid rule:
FAIL - @page { @left-bottom { } } should be a valid rule:
FAIL - @page { @right-top { } } should be a valid rule:
FAIL - @page { @right-middle { } } should be a valid rule:
FAIL - @page { @right-bottom { } } should be a valid rule:
FAIL
- @page { @top-left-corner { } } should be a valid rule:
- /css/css-page/parsing/margin-rules-002.html [wpt.fyi]
- margin rule without any preceding @page properties:
FAIL - margin rule followed by @page properties:
FAIL - margin rule preceded by @page properties:
FAIL - margin rules with @page properties between:
FAIL
- margin rule without any preceding @page properties:
- /css/css-page/parsing/page-orientation-computed.tentative.html [wpt.fyi]
- page-orientation is not a property (only a descriptor):
FAIL
- page-orientation is not a property (only a descriptor):
Comment 4•1 month ago
|
||
| bugherder | ||
Comment 5•1 month ago
|
||
| bugherder | ||
Description
•