1569345 - Some object-fit WPT tests need a fuzzy annotation (rather than fails)

Status: RESOLVED FIXED

(Core :: Layout, task, P3)

Description

[Daniel Holbert [:dholbert]]

We have some object-fit-*-png-* WPT tests that are annotated as failing (on non-webrender) due to a fuzzy image-scaling issue. This is basically fine -- the tests are only expected to be pixel-perfect if they can get image-rendering: pixelated, which we don't yet support.

Since it's not too many pixels differing, we should just annotate these as fuzzy rather than failing, to better reflect reality & to get a bit more strictness.

Comment 1

[Daniel Holbert [:dholbert]]

Here's a Try run that shows the failures for object-fit-cover-png-001 and -002 (after I've removed their .ini files):
https://treeherder.mozilla.org/#/jobs?repo=try&revision=38d8022f5b3470804452b32673095bd216aa862f

Comment 2

[Daniel Holbert [:dholbert]]

Another Try run, with a few more .ini files removed/tweaked, and with bespoke fuzzy annotations based on that ^^ run combined with a local ./mach wpt run in this directory:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=ec1b7bcebb538399339e3246dec9c09168b5f6f0

(I anticipate that this run will have some orange due to differences between platforms.)

Comment 3

[Daniel Holbert [:dholbert]]

Attachment: Bug 1569345: Use more specific/strict annotations object-fit & object-position WPT tests. (no review, just adjusting WPT test annotations)

All of these tests current fail due to fuzzy upscaling/downscaling behavior,
which the tests aim to work around using image-rendering: pixelated, but we
don't yet support that feature. I've added the bug link for that feature to
these .ini files, so that we'll get a clue to remove these annotations once we
fix that bug and implement that feature.

Comment 4

[Daniel Holbert [:dholbert]]

Updated Try run: https://treeherder.mozilla.org/#/jobs?repo=try&revision=277cd1e490fffcb67b359d2af210d60061ea76bd

Still waiting on Android test runs, but everything else is green.

Comment 5

[Daniel Holbert [:dholbert]]

Try run with Android annotations added:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=8333e0ed5daa36441fe3146a608e34672c7f9bbe

Looks good, gonna go ahead and land.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b7103a15a90f
Use more specific/strict annotations object-fit & object-position WPT tests.

Comment 7

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/b7103a15a90f