1953210 - WPT reftests don't compare pixel count correctly

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect)

Description

[Emilio Cobos Álvarez [:emilio]]

This is why tests like https://wpt.fyi/results/css/css-view-transitions/nested?label=master&label=experimental&aligned&q=%2Fcss%2Fcss-view-transitions%2Fnested%2Fcompute-explicit-name-direct.tentative.html appear to pass in wpt.fyi.

Comment 1

[Emilio Cobos Álvarez [:emilio]]

Attachment: Bug 1953210 - Fix reftest pixel count comparison. r=jgraham

Comment 2

[Emilio Cobos Álvarez [:emilio]]

https://treeherder.mozilla.org/jobs?repo=try&revision=b8d8a80acdb7333a52563a12b6eff866a8339efd

Comment 3

[Emilio Cobos Álvarez [:emilio]]

Attachment: Bug 1953210 - Fix test fuzzy ranges, or mark actually failing tests as failing. r=jgraham,#layout

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/56a4e0938614
Fix reftest pixel count comparison. r=jgraham,webdriver-reviewers
https://hg.mozilla.org/integration/autoland/rev/a321bb8a696a
Fix test fuzzy ranges, or mark actually failing tests as failing. r=dholbert

Comment 5

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/51285 for changes under testing/web-platform/tests

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0098eb51730d
Annotate a nested vt test as flaky.
https://hg.mozilla.org/integration/autoland/rev/d0ec02e9e780
Tweak fuzz of transform-input-005.html

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5887cddf34a4
Keep macOS tests happy.
https://hg.mozilla.org/integration/autoland/rev/6fbf5094c384
Mark a few view transitions tests as flaky.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bcc40a611246
new-content-scaling passes in some windows configurations.
https://hg.mozilla.org/integration/autoland/rev/b614f1570585
old-content-is-inline is very fuzzy on macOS as well.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/bec9c7796872
old-content-is-inline is very fuzzy on macOS as well.

Comment 10

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/56a4e0938614
https://hg.mozilla.org/mozilla-central/rev/a321bb8a696a
https://hg.mozilla.org/mozilla-central/rev/0098eb51730d
https://hg.mozilla.org/mozilla-central/rev/d0ec02e9e780
https://hg.mozilla.org/mozilla-central/rev/5887cddf34a4
https://hg.mozilla.org/mozilla-central/rev/6fbf5094c384
https://hg.mozilla.org/mozilla-central/rev/bec9c7796872

Comment 11

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot

Comment 12

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/bcc40a611246
https://hg.mozilla.org/mozilla-central/rev/b614f1570585