Open Bug 1116972 Opened 9 years ago Updated 1 year ago

Intermittent Linux-32 reftest failures where data: URLs are string-equal but image comparison says they're not

Categories

(Testing :: Reftest, defect)

Product:
Testing
Component:
Reftest
Platform:
x86
Linux
Type:
defect

Tracking

(Not tracked)

People

(Reporter: philor, Unassigned)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

reftest.log
14.89 KB, text/plain
Details
Attached file reftest.log — 
660732 pixels seems like rather a lot to differ, particularly when you consider that the two images appear to be identical.

https://treeherder.mozilla.org/logviewer.html#?job_id=1573907&repo=fx-team

15:53:15 INFO - REFTEST TEST-START | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/svg/clipPath-and-transform-01.svg
15:53:15 INFO - REFTEST TEST-LOAD | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/svg/clipPath-and-transform-01.svg | 4047 / 5854 (69%)
15:53:15 INFO - ++DOMWINDOW == 55 (0x90235400) [pid = 3321] [serial = 11860] [outer = 0xa12bcc00]
15:53:16 INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/svg/clipPath-and-transform-01.svg | image comparison (==), max difference: 255, number of differing pixels: 660732
...
15:53:16 INFO - REFTEST INFO | Saved log: START file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/svg/clipPath-and-transform-01.svg
15:53:16 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
15:53:16 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
15:53:16 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
15:53:16 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
15:53:16 INFO - REFTEST INFO | Saved log: RecordResult fired
15:53:16 INFO - REFTEST INFO | Saved log: RecordResult fired
15:53:16 INFO - REFTEST INFO | Loading a blank page
15:53:16 INFO - ++DOMWINDOW == 56 (0x902e6200) [pid = 3321] [serial = 11861] [outer = 0xa12bcc00]
15:53:16 INFO - REFTEST TEST-END | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/svg/clipPath-and-transform-01.svg
(In reply to TBPL Robot from comment #1)
> https://treeherder.mozilla.org/ui/logviewer.html#?repo=fx-team&job_id=1573907

The two data: URIs (for test and reference) string-compare as equal, which means there's something wrong with our diagnostics here...
And philor pointed out the same for the comment 2 logs prior to my comment 3.
Summary: Intermittent clipPath-and-transform-01.svg | image comparison (==), max difference: 255, number of differing pixels: 660732 → Intermittent Linux-32 reftest failures where data: URLs are string-equal but image comparison says they're not
Sort of a fun question, just how often we've filed intermittent failure bugs without looking at the lack of circled differences in the reftest analyzer, and then nobody has looked at the bug.
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.