981640 - Intermittent layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 32

Status: RESOLVED INACTIVE

(Core :: SVG, defect, P3)

Description

[Ryan VanderMeulen [:RyanVM]]

Attachment: test screenshot

This was previously annotated as fuzzy, but that was removed in bug 981110. The fuzziness is around curved lines like the eyes and mouth.

https://tbpl.mozilla.org/php/getParsedLog.php?id=35877714&tree=Mozilla-Inbound

Rev5 MacOSX Mountain Lion 10.8 mozilla-inbound debug test reftest on 2014-03-10 03:28:24 PDT for push fb23f20f9c6c
slave: talos-mtnlion-r5-064

03:59:18     INFO -  REFTEST TEST-START | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg
03:59:18     INFO -  REFTEST TEST-LOAD | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | 8473 / 10720 (79%)
03:59:18     INFO -  ++DOMWINDOW == 185 (0x1388b46c0) [pid = 1244] [serial = 24168] [outer = 0x10e7757d0]
03:59:18     INFO -  REFTEST TEST-LOAD | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1-ref.svg | 8473 / 10720 (79%)
03:59:18     INFO -  ++DOMWINDOW == 186 (0x1388abda0) [pid = 1244] [serial = 24169] [outer = 0x10e7757d0]
03:59:18     INFO -  REFTEST TEST-UNEXPECTED-FAIL | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 32
03:59:18     INFO -  REFTEST   IMAGE 1 (TEST): 
03:59:18     INFO -  REFTEST   IMAGE 2 (REFERENCE): 
03:59:18     INFO -  REFTEST INFO | Saved log: START file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg
03:59:18     INFO -  REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
03:59:18     INFO -  REFTEST INFO | Saved log: Initializing canvas snapshot
03:59:18     INFO -  REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
03:59:18     INFO -  REFTEST INFO | Saved log: [CONTENT] RecordResult fired
03:59:18     INFO -  REFTEST INFO | Saved log: RecordResult fired
03:59:18     INFO -  REFTEST INFO | Saved log: START file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1-ref.svg
03:59:18     INFO -  REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
03:59:18     INFO -  REFTEST INFO | Saved log: Initializing canvas snapshot
03:59:18     INFO -  REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
03:59:18     INFO -  REFTEST INFO | Saved log: [CONTENT] RecordResult fired
03:59:18     INFO -  REFTEST INFO | Saved log: RecordResult fired
03:59:18     INFO -  REFTEST INFO | Loading a blank page
03:59:18     INFO -  REFTEST TEST-END | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg

Comment 1

[Ryan VanderMeulen [:RyanVM]]

Attachment: reference screenshot

Comment 2

[Daniel Holbert [:dholbert]]

Once the tree reopens, I'll land a patch to add "fuzzy-if(cocoaWidget,1,32)" at the beginning of paced-1.svg's line in the manifest (with a comment pointing to this bug).

rs=RyanVM granted over IRC.

Comment 3

[Daniel Holbert [:dholbert]]

Landed the fuzzy annotation mentioned in comment 2:
 https://hg.mozilla.org/integration/mozilla-inbound/rev/681b3c6bcf49

Comment 4

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=35937423&tree=Fx-Team
Windows 7 32-bit fx-team debug test reftest on 2014-03-11 04:37:05
revision: 15b0a825f153
slave: t-w732-ix-103

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 5

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/681b3c6bcf49

Comment 6

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=36134862&tree=B2g-Inbound
WINNT 6.2 b2g-inbound debug test reftest on 2014-03-14 04:09:24
revision: 4a581a135772
slave: t-w864-ix-075

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 7

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=36160282&tree=Mozilla-Inbound
WINNT 6.2 mozilla-inbound debug test reftest on 2014-03-14 13:01:50
revision: 6bf817013e40
slave: t-w864-ix-077

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 8

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=36216024&tree=Fx-Team
WINNT 6.2 fx-team debug test reftest on 2014-03-15 15:39:28
revision: eb5bed4a046e
slave: t-w864-ix-009

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 9

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=36237887&tree=Mozilla-Inbound
Windows 7 32-bit mozilla-inbound debug test reftest on 2014-03-16 10:37:20
revision: db46457d0731
slave: t-w732-ix-032

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 10

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=36358917&tree=Mozilla-Central
Windows 7 32-bit mozilla-central debug test reftest on 2014-03-18 15:21:20
revision: 3ac88ba5f2d4
slave: t-w732-ix-010

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 11

[Daniel Holbert [:dholbert]]

The 1px difference on Windows (Comment 6 through 10) is a fuzzy pixel at the outer left edge of the bottom-left smiley, FWIW.

Pushing a winWidget-specific fuzzy annotation to silence it:
 https://hg.mozilla.org/integration/mozilla-inbound/rev/a41d8a972b65

Comment 12

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/a41d8a972b65

Comment 13

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=38898659&tree=Mozilla-B2g30-v1.4
Windows 7 32-bit mozilla-b2g30_v1_4 debug test reftest on 2014-05-01 14:42:58
revision: c41dc91f683d
slave: t-w732-ix-094

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 14

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=40398998&tree=B2g-Inbound
WINNT 6.2 b2g-inbound debug test reftest on 2014-05-26 04:16:31
revision: eab1c325d9fb
slave: t-w864-ix-094

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 15

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=40978443&tree=Mozilla-Release
WINNT 6.2 mozilla-release debug test reftest on 2014-06-03 12:25:33
revision: 909e19d1f9fc
slave: t-w864-ix-116

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 1

Comment 16

[Legacy TBPL/Treeherder Robot]

:nigelb
https://tbpl.mozilla.org/php/getParsedLog.php?id=43194108&tree=Mozilla-Inbound
WINNT 6.2 mozilla-inbound debug test reftest on 2014-07-05 12:44:22
revision: c3496e9453d3
slave: t-w864-ix-077

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 17

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=43661270&tree=Mozilla-Aurora
WINNT 6.2 mozilla-aurora debug test reftest on 2014-07-11 18:42:34
revision: 7245c4526cd5
slave: t-w864-ix-014

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 18

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=43721665&tree=B2g-Inbound
WINNT 6.2 b2g-inbound debug test reftest on 2014-07-13 20:26:14
revision: c9fd02033e8f
slave: t-w864-ix-106

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 19

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=43930087&tree=Mozilla-Inbound
WINNT 6.2 mozilla-inbound debug test reftest on 2014-07-16 05:21:40
revision: aca7944ee3df
slave: t-w864-ix-047

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 20

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=45960540&tree=Fx-Team
WINNT 6.2 fx-team debug test reftest on 2014-08-14 11:36:47
revision: 8a0fcef2dc38
slave: t-w864-ix-028

<bound method DesktopUnittest.run_command of <__main__.DesktopUnittest object at 0x02700F70>> failed after 1 tries!
<bound method DesktopUnittest.run_command of <__main__.DesktopUnittest object at 0x02700F70>> failed after 1 tries!
REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 21

[Ryan VanderMeulen [:RyanVM]]

Guess we need to make this a bit fuzzier.

Comment 22

[Daniel Holbert [:dholbert]]

Yup.

The mismatching pixels in the Windows failures in comment 19 & comment 20 (and probably the comments before as well; haven't looked at those) are 4 pixels just outside the rightmost edge of the top-center smileyface. They're white in the reference, and near-white in the testcase.

Comment 23

[Daniel Holbert [:dholbert]]

Landed a patch to increase fuzziness threshold on Windows to "15,4" (up from "1,1" in comment 11), which should take care of the recent reports here:
  https://hg.mozilla.org/integration/mozilla-inbound/rev/d79ed36df3ac

Comment 24

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/d79ed36df3ac

Comment 25

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-beta&job_id=220983
repository: mozilla-beta
start_time: 2015-01-20T09:00:52
who: rvandermeulen[at]mozilla[dot]com
machine: t-snow-r4-0143
buildname: Rev4 MacOSX Snow Leopard 10.6 mozilla-beta debug test reftest
revision: fae52bd681e0

REFTEST TEST-UNEXPECTED-FAIL | file:///builds/slave/talos-slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 1, number of differing pixels: 37

Comment 26

[Daniel Holbert [:dholbert]]

Comment 25 has fuzzy pixels on the upper-left and bottom-right sides of each smiley-face's eyeball-circles, along with one fuzzy pixel near the upper-left of each smiley-face's border.

The test is currently annotated with 32 pixels being fuzzy on Mac. Comment 25 suggests that we should bump that up to 37 pixels. Probably worth waiting for more data first, though, since that was the first failure in ~5 months.

Comment 27

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-b2g32_v2_0&job_id=96486
repository: mozilla-b2g32_v2_0
start_time: 2015-02-10T20:28:08
who: philringnalda[at]gmail[dot]com
machine: t-w864-ix-021
buildname: WINNT 6.2 mozilla-b2g32_v2_0 debug test reftest
revision: d47ec000ee85

REFTEST TEST-UNEXPECTED-FAIL | file:///C:/slave/test/build/tests/reftest/tests/layout/reftests/svg/smil/transform/paced-1.svg | image comparison (==), max difference: 15, number of differing pixels: 4

Comment 28

[BMO Automation]

Bulk assigning P3 to all open intermittent bugs without a priority set in Firefox components per bug 1298978.

Comment 29

[BugBot [:suhaib / :marco/ :calixte]]

The leave-open keyword is there and there is no activity for 6 months.
:svoisen, maybe it's time to close this bug?

Comment 30

[Daniel Holbert [:dholbert]]

The fuzzy annotation here isn't severe enough that anyone should reasonably spend time investigating this.

The test still fails without the annotation, so this isn't "fixed"; I guess let's close it as "inactive".