1592998 - Intermittent svg/smil/transform/paced-1.svg == svg/smil/transform/paced-1-ref.svg | image comparison, max difference: 5, number of differing pixels: 101

Status: RESOLVED FIXED

(Core :: SVG, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: opoprus [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=273870897&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/AyJTXLEES4GVB3E62XDfbQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/AyJTXLEES4GVB3E62XDfbQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-10-31T11:18:44.119Z] 11:18:44 INFO - REFTEST TEST-START | file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg == file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1-ref.svg
[task 2019-10-31T11:18:44.120Z] 11:18:44 INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | 2 / 15 (13%)
[task 2019-10-31T11:18:44.140Z] 11:18:44 INFO - ++DOMWINDOW == 10 (0x124256c00) [pid = 2032] [serial = 10] [outer = 0x123578020]
[task 2019-10-31T11:18:44.180Z] 11:18:44 INFO - [Child 2033, Main Thread] WARNING: No CID found when attempting to map contract ID: file /builds/worker/workspace/build/src/xpcom/components/nsComponentManager.cpp, line 729
[task 2019-10-31T11:18:44.239Z] 11:18:44 INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1-ref.svg | 2 / 15 (13%)
[task 2019-10-31T11:18:44.245Z] 11:18:44 INFO - ++DOMWINDOW == 11 (0x11b34a400) [pid = 2032] [serial = 11] [outer = 0x123578020]
[task 2019-10-31T11:18:44.313Z] 11:18:44 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (5, 101) <= (3, 50)
[task 2019-10-31T11:18:44.396Z] 11:18:44 INFO - ++DOMWINDOW == 12 (0x11b34fc00) [pid = 2032] [serial = 12] [outer = 0x123578020]
[task 2019-10-31T11:18:44.487Z] 11:18:44 INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg == file:///Users/cltbld/tasks/task_1572519344/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1-ref.svg | image comparison, max difference: 5, number of differing pixels: 101

Comment 1

[Intermittent Failures Robot]

26 failures in 4314 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 15
• mozilla-esr68: 1
• try: 1

Platform breakdown:

• macosx1014-64: 3
• windows7-32: 2
• linux64-ccov: 14
• windows7-32-mingwclang: 4
• linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 2

[Intermittent Failures Robot]

19 failures in 963 pushes (0.02 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 5

Platform breakdown:

• windows7-32-mingwclang: 4
• windows7-32: 6
• macosx1014-64: 5
• linux64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-11-07&endday=2019-11-07&tree=all

Comment 3

[Intermittent Failures Robot]

23 failures in 895 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-central: 8
• try: 6

Platform breakdown:

• windows7-32-mingwclang: 3
• linux64-ccov: 12
• macosx1014-64: 4
• windows7-32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-11-08&endday=2019-11-08&tree=all

Comment 4

[Intermittent Failures Robot]

95 failures in 4850 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #11 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 41
• mozilla-central: 43
• try: 10
• mozilla-inbound: 1

Platform breakdown:

• windows7-32-mingwclang: 20
• windows7-32: 18
• linux64-ccov: 40
• linux64: 5
• macosx1014-64: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-11-04&endday=2019-11-10&tree=all

Comment 5

[Intermittent Failures Robot]

19 failures in 966 pushes (0.02 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 10
• mozilla-central: 9

Platform breakdown:

• windows7-32-mingwclang: 3
• linux64-ccov: 8
• windows7-32: 6
• macosx1014-64: 1
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-11-14&endday=2019-11-14&tree=all

Comment 6

[Cosmin Sabou [:CosminS]]

Geoff, any ideas what should be done here? Should we increase the fuzzy if range on windows, mac and linux by the looks of https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-10-16&endday=2019-11-15&tree=trunk&bug=1592998 or skip it altogether?

Comment 7

[Geoff Brown [:gbrown]]

dholbert looked at this recently in bug 1503470; let's ask him...

Comment 8

[Daniel Holbert [:dholbert]]

(In reply to Geoff Brown [:gbrown] from comment #7)

dholbert looked at this recently in bug 1503470; let's ask him...

(That was paced-1.svg, whereas this is paced-2.svg. But yes, looks like the same issue.)

We should add a fuzzy annotation that satisfies the current amount of fuzziness that we're observing. (I glanced at a linux and a windows reftest-analyzer view, and it's just a few pixels on the curvy edges of circles, so the failure is likely due to an unimportant/uninteresting antialiasing difference.)

So: that's my suggestion, but I don't have cycles at the moment to look at the various platforms/logs and put together the right fuzzy annotation. Could one of you do that?

Comment 9

[Daniel Holbert [:dholbert]]

(In reply to Daniel Holbert [:dholbert] from comment #8)

(In reply to Geoff Brown [:gbrown] from comment #7)

dholbert looked at this recently in bug 1503470; let's ask him...

(That was paced-1.svg, whereas this is paced-2.svg. But yes, looks like the same issue.)

Er... I could've sworn I saw paced-2.svg somewhere, but maybe I misread -- on second glance, I guess this is paced-1.svg after all. :)

Anyway: the fuzzy annotation for this test does just need a "bump". We should not disable/skip the test.

Comment 10

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1592998 - Adjust paced-1.svg fuzzy if range because of frequent failures on mac, linux and windows. r=dholbert

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bfddca445c5e
Adjust paced-1.svg fuzzy if range because of frequent failures on mac, linux and windows. r=dholbert

Comment 12

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/bfddca445c5e

Comment 13

[Intermittent Failures Robot]

66 failures in 4207 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #23 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 36
• mozilla-central: 27
• try: 2
• mozilla-esr68: 1

Platform breakdown:

• linux64: 4
• windows7-32-mingwclang: 18
• linux64-ccov: 22
• windows7-32: 20
• macosx1014-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1592998&startday=2019-11-11&endday=2019-11-17&tree=all