1616369 - Perma tier 2 TEST-UNEXPECTED-PASS | bugs/448193.html == bugs/448193-ref.html | image comparison, max difference: 0, number of differing pixels: 0

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: cbrindusan [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=289386878&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZBwfY8VKTwqXyp6_9Y8Xgg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZBwfY8VKTwqXyp6_9Y8Xgg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-02-18T19:14:25.154Z] 19:14:25 INFO - REFTEST TEST-START | layout/reftests/bugs/448193.html == layout/reftests/bugs/448193-ref.html
[task 2020-02-18T19:14:25.154Z] 19:14:25 INFO - REFTEST TEST-LOAD | http://10.7.205.222:8854/tests/layout/reftests/bugs/448193.html | 1420 / 1894 (74%)
[task 2020-02-18T19:14:25.154Z] 19:14:25 INFO - REFTEST TEST-LOAD | http://10.7.205.222:8854/tests/layout/reftests/bugs/448193-ref.html | 1420 / 1894 (74%)
[task 2020-02-18T19:14:25.154Z] 19:14:25 INFO - REFTEST INFO | REFTEST fuzzy test (43, 4) <= (0, 0) <= (43, 4)
[task 2020-02-18T19:14:25.154Z] 19:14:25 WARNING - REFTEST TEST-UNEXPECTED-PASS | layout/reftests/bugs/448193.html == layout/reftests/bugs/448193-ref.html | image comparison, max difference: 0, number of differing pixels: 0

Comment 1

[Cristina Coroiu [:ccoroiu]]

Retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Android%2C8.0%2CPixel2%2CAArch64%2CQuantumRender%2Copt%2CReftests%2Ctest-android-hw-p2-8-0-android-aarch64-qr%2Fopt-geckoview-reftest-e10s-3%2CR%28R3%29&tochange=a2caf09a5e7cadd78e5a12c4d715d3f0c996e48c&fromchange=d49a0086f65ae46e95372b09fb46a6296b2b4b83

Comment 2

[Intermittent Failures Robot]

22 failures in 767 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 9
• autoland: 13

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1616369&startday=2020-02-19&endday=2020-02-19&tree=all

Comment 3

[Jamie Nicol [:jnicol]]

Sweet, we can enable/unfuzz these two tests thanks to 1612620. (I guess the first of them should have been fails-if rather than fuzzy-if, but because the corners are so small only a few pixels were the wrong colour, so it looked like a fuzzing issue!)

Comment 4

[Razvan Maries]

Since bug 1612620 landed this is a perma tier 2 failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&duplicate_jobs=visible&selectedJob=289678645&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&fromchange=f81c96516a0c58672fc572a210505f3a0a99b814&searchStr=android%2C8.0%2Cpixel2%2Caarch64%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-android-aarch64-qr%2Fopt-geckoview-reftest-e10s-3%2Cr%28r3%29

Comment 5

[Razvan Maries]

Attachment: Bug 1616369 - Enabled 447749-1.html and 447749-1-ref.html. r=Aryx

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/349b37589194
Enabled 447749-1.html and 447749-1-ref.html. r=jnicol

Comment 7

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/349b37589194

Comment 8

[Intermittent Failures Robot]

20 failures in 882 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• try: 1
• mozilla-central: 4

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1616369&startday=2020-02-20&endday=2020-02-20&tree=all

Comment 9

[Intermittent Failures Robot]

49 failures in 4045 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 35
• mozilla-central: 13
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 49

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1616369&startday=2020-02-17&endday=2020-02-23&tree=all