1571335 - Perma tier2 windows10-aarch64 /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html

Status: RESOLVED FIXED

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=259866624&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/KsSdBmitQOyRqmWPY1NZAw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/KsSdBmitQOyRqmWPY1NZAw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

01:59:14 INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html
01:59:14 INFO - PID 11664 | 1564970354435 Marionette INFO Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002-ref.html
01:59:14 INFO - PID 11664 | JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 2669: TypeError: tabbrowser.getTabForBrowser is not a function
01:59:14 INFO - PID 11664 | JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 2669: TypeError: tabbrowser.getTabForBrowser is not a function
01:59:14 INFO - PID 11664 | 1564970354780 Marionette INFO Allowed 1782-1782 pixels different, maximum difference per channel 105-105
01:59:14 INFO - TEST-UNEXPECTED-FAIL | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002c.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-fit-cover-png-002-ref.html
01:59:14 INFO - Found 3502 pixels different, maximum difference per channel 107

Comment 1

[Noemi Erli[:noemi_erli]]

This seems to be a regression from https://bugzilla.mozilla.org/show_bug.cgi?id=1569345

Daniel could you please take a look at this?

Comment 2

[Intermittent Failures Robot]

7 failures in 4439 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform breakdown:

• windows10-aarch64: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571335&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 3

[Daniel Holbert [:dholbert]]

From one of the logs:

• object-fit-cover-png-002c.html
  ** Allowed 1782-1782 pixels different, maximum difference per channel 105-105
  ** Found 3502 pixels different, maximum difference per channel 107

• object-fit-fill-png-002c.html
  ** Allowed 1764-1764 pixels different, maximum difference per channel 14-14
  ** Found 3153 pixels different, maximum difference per channel 16

• object-position-png-002c.html
  ** Allowed 388-388 pixels different, maximum difference per channel 166-166
  ** Found 388 pixels different, maximum difference per channel 165

Comment 4

[Daniel Holbert [:dholbert]]

Attachment: Bug 1571335: Adjust fuzzy thresholds for three object-fit/object-position WPT tests to accommodate Win10 AArch64 results. (no review, test-annotation only)

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0654c6ea519a
Adjust fuzzy thresholds for three object-fit/object-position WPT tests to accommodate Win10 AArch64 results. (no review, test-annotation only)

Comment 6

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/0654c6ea519a

Comment 7

[Raul Gurzau (:RaulG)]

Seems to still fail on Windows 10 AArch64 opt: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&revision=8437b860258fe0a83da254761f7c8f5b221f7116&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-reftests-e10s-4%2Cw%28wr4%29

Comment 8

[Daniel Holbert [:dholbert]]

That is a slightly-more-fuzzy-than-the-original-report failure. Quoting the log:

INFO Allowed 1782-3502 pixels different, maximum difference per channel 105-105
INFO - TEST-UNEXPECTED-FAIL | [...] object-fit-cover-png-002-ref.html
INFO - Found 3502 pixels different, maximum difference per channel 107

Note the difference is 107, a bit greater than the allowed 105.

I'll push a patch to bump the allowed range to 105-107.

Comment 9

[Daniel Holbert [:dholbert]]

Er, I guess the original log had 107 as well, and I just didn't notice it since it was a smaller difference than the num-pixels discrepancy.

Anyway, I'll still adjust it to 105-107, because normal (non-aarch64) windows has maxDifference=105 in its fuzzy failures, so we do need to allow for that.

Comment 10

[Daniel Holbert [:dholbert]]

Attachment: Bug 1571335 followup: Increase tolerance for Windows object-fit-cover-png-002c.html fuzzy test failure. (no review, test-annotation-only)

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c6d6cf2c5aed
followup: Increase tolerance for Windows object-fit-cover-png-002c.html fuzzy test failure. (no review, test-annotation-only)

Comment 12

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/c6d6cf2c5aed

Comment 13

[Intermittent Failures Robot]

16 failures in 4666 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 16

Platform breakdown:

• windows10-aarch64: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571335&startday=2019-08-05&endday=2019-08-11&tree=all