1593615 - Perma tier2 async-scrolling/perspective-scrolling-1.html | image comparison, max difference: 5, number of differing pixels: 1503 | clipped-mixblendmode-containing-unclipped-stuff.html | image comparison, max difference: 3, number of differing pixels: 849

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=274345100&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/M1pwVu6WRHG0dF9lWkoomg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/M1pwVu6WRHG0dF9lWkoomg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-START | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-4.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-ref.html
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-LOAD | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-4.html | 1398 / 1977 (70%)
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (0, 0) <= (6, 4)
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-PASS | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-4.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-END | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-4.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/offscreen-clipped-blendmode-ref.html
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-START | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1-ref.html
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-LOAD | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1.html | 1399 / 1977 (70%)
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST TEST-LOAD | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1-ref.html | 1399 / 1977 (70%)
[task 2019-11-04T09:05:18.400Z] 09:05:18 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (5, 1503) <= (7, 1406)
[task 2019-11-04T09:05:18.400Z] 09:05:18 WARNING - REFTEST TEST-UNEXPECTED-FAIL | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1-ref.html | image comparison, max difference: 5, number of differing pixels: 1503
[task 2019-11-04T09:05:18.407Z] 09:05:18 INFO - REFTEST IMAGE 1 (TEST):
[task 2019-11-04T09:05:18.407Z] 09:05:18 INFO - REFTEST IMAGE 2 (REFERENCE):
[task 2019-11-04T09:05:18.409Z] 09:05:18 INFO - REFTEST TEST-END | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-1-ref.html
[task 2019-11-04T09:05:18.409Z] 09:05:18 INFO - REFTEST TEST-START | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-2.html == http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-2-ref.html
[task 2019-11-04T09:05:18.409Z] 09:05:18 INFO - REFTEST TEST-LOAD | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-2.html | 1400 / 1977 (70%)
[task 2019-11-04T09:05:18.409Z] 09:05:18 INFO - REFTEST TEST-LOAD | http://10.7.205.206:8854/tests/layout/reftests/async-scrolling/perspective-scrolling-2-ref.html | 1400 / 1977 (70%)
[task 2019-11-04T09:05:18.409Z] 09:05:18 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (0, 0) <= (7, 4)

Comment 1

[Alexandru Michis [:malexandru]]

Dzmitry, Glenn, could you take a look at this?
It seems to be caused by the changes pushed in Bug 1591529:

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C8.0%2Cpixel2%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-2%2Cr%28r2%29&group_state=expanded&tochange=5647ec4ba6f2566912e71637d2c1e063d899c103&fromchange=590a140740ae82dbfc658dce8d3766f9fad3fefa&selectedJob=274344633

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C8.0%2Cpixel2%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-4%2Cr%28r4%29&group_state=expanded&tochange=5647ec4ba6f2566912e71637d2c1e063d899c103&fromchange=590a140740ae82dbfc658dce8d3766f9fad3fefa&selectedJob=274337995

Comment 2

[Glenn Watson [:gw]]

I took a quick look at the reftest analyzer. Looks like these need to have fuzziness adjusted on android - I'll open a patch tomorrow to update the fuzziness annotations.

Comment 3

[Glenn Watson [:gw]]

Attachment: Bug 1593615 - Update annotations for android fuzziness.

Comment 4

[Glenn Watson [:gw]]

Updated the fuzziness annotations for tier2 android in the attached patch.

Kicked off a pending try run (hopefully I selected the right jobs):
https://treeherder.mozilla.org/#/jobs?repo=try&revision=1f3b9ae1f0c7d911f16d1017332403b76a50dec2

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e4a001fd4582
Update annotations for android fuzziness. r=ktaeleman

Comment 6

[Intermittent Failures Robot]

30 failures in 862 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 11
• try: 4

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 30

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1593615&startday=2019-11-04&endday=2019-11-04&tree=all

Comment 7

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/e4a001fd4582

Comment 8

[Alexandru Michis [:malexandru]]

This looks to still be permafailing:
https://treeherder.mozilla.org/#/jobs?repo=autoland&fromchange=be6e3fd97eddc4ae3058960fcff49919e93f9890&searchStr=android%2C8.0%2Cpixel2%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-2%2Cr%28r2%29&tochange=17546e539b640c17b639e612a711db7d5834b20b&selectedJob=274524651

Glenn, could you take another look at it? Perhaps the fuzziness needs to be futher increased.

Comment 9

[Glenn Watson [:gw]]

Sure, I'll look into this again today.

Comment 10

[Glenn Watson [:gw]]

Attachment: Bug 1593615 - Bump up fuzziness on android async scrolling test

Comment 11

[Glenn Watson [:gw]]

Looks like the fuzziness value on the initial failures wasn't high enough on one of the tests. I've bumped it up a bit more. I can't verify that it passes now, since android builders on try all seem backed up, but this should fix it.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f385d5a5f4d5
Bump up fuzziness on android async scrolling test r=kvark

Comment 13

[Intermittent Failures Robot]

24 failures in 1017 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 9
• mozilla-inbound: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1593615&startday=2019-11-05&endday=2019-11-05&tree=all

Comment 14

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/f385d5a5f4d5

Comment 15

[Intermittent Failures Robot]

54 failures in 4850 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 29
• mozilla-central: 20
• try: 4
• mozilla-inbound: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 54

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1593615&startday=2019-11-04&endday=2019-11-10&tree=all