1567397 - Permafailing tier 2 TEST-UNEXPECTED-PASS | bugs/1562733-rotated-nastaliq-1.html == bugs/1562733-rotated-nastaliq-1-ref.html | image comparison, max difference: 253, number of differing pixels: 1392

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=257323997&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/VgQqpg9yR6a95dZ4VnXk-Q/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/VgQqpg9yR6a95dZ4VnXk-Q/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

05:04:19 INFO - REFTEST TEST-START | http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1.html == http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1-ref.html
05:04:19 INFO - REFTEST TEST-LOAD | http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1.html | 567 / 1999 (28%)
05:04:19 INFO - REFTEST TEST-LOAD | http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1-ref.html | 567 / 1999 (28%)
05:04:19 INFO - REFTEST INFO | REFTEST fuzzy test (253, 1397) <= (253, 1392) <= (253, 1397)
05:04:19 INFO - REFTEST TEST-UNEXPECTED-PASS | http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1.html == http://10.7.205.203:8854/tests/layout/reftests/bugs/1562733-rotated-nastaliq-1-ref.html | image comparison, max difference: 253, number of differing pixels: 1392

Comment 1

[Natalia Csoregi [:nataliaCs]]

Seems to have started once Bug 1513423 landed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&revision=6b47fb297b399587983bceab12f550376ba268e3&searchStr=Android%2C8.0%2CPixel2%2CQuantumRender

Jonathan, any chance you could take a look? Thank you.

Comment 2

[Jonathan Kew [:jfkthame]]

Attachment: Bug 1567397 - Adjust fuzzy annotations for minor subpixel changes in rotated nastaliq tests. r=heycam

Comment 3

[Intermittent Failures Robot]

22 failures in 644 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 22

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567397&startday=2019-07-19&endday=2019-07-19&tree=all

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/36c13d68ae27
Adjust fuzzy annotations for minor subpixel changes in rotated nastaliq tests. r=heycam

Comment 5

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/36c13d68ae27

Comment 6

[Intermittent Failures Robot]

34 failures in 4298 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 26
• autoland: 8

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 34

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567397&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 7

[Marian Raiciof [:marauder]]

== Change summary for alert #22025 (as of Sun, 21 Jul 2019 18:32:01 GMT) ==

Improvements:

10% raptor-tp6m-youtube-geckoview-cold loadtime android-hw-p2-8-0-arm7-api-16 pgo 1,742.38 -> 1,575.25
9% raptor-tp6m-youtube-geckoview-cold loadtime android-hw-p2-8-0-android-aarch64 pgo 1,767.46 -> 1,600.00

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22025

Comment 8

[Emilio Cobos Álvarez (:emilio)]

Comment 7 doesn't make sense, there has to be another cause for this. This patch only tweaked test annotations.

Comment 9

[Marian Raiciof [:marauder]]

Thanks for the info Emilio.