Closed Bug 1516006 Opened 5 years ago Closed 5 years ago

Intermittent layout/svg/tests/test_filter_crossorigin.html | reftest comparison: == Testcase loaded from mochi.test Reference: black/yellow

Categories

(Core :: SVG, defect, P5)

defect

Tracking

()

RESOLVED FIXED

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=218360310&repo=autoland

https://queue.taskcluster.net/v1/task/A8rVmSYISu2cdDEx3_uzvg/runs/0/artifacts/public/logs/live_backing.log

INFO - TEST-START | layout/svg/tests/test_filter_crossorigin.html
16:36:22     INFO - GECKO(7088) | MEMORY STAT | vsize 1404MB | vsizeMaxContiguous 130255544MB | residentFast 81MB | heapAllocated 15MB
16:36:22     INFO - TEST-OK | layout/svg/tests/test_filter_crossorigin.html | took 68ms
16:36:22     INFO - TEST-START | Shutdown
16:36:22     INFO - Passed:  6
16:36:22     INFO - Failed:  0
16:36:22     INFO - Todo:    0
16:36:22     INFO - Mode:    e10s
16:36:22     INFO - Slowest: 1160ms - /tests/layout/svg/tests/test_filter_crossorigin.html
16:36:22     INFO - SimpleTest START Loop 4
16:36:22     INFO - TEST-START | layout/svg/tests/test_filter_crossorigin.html
16:36:22     INFO - TEST-INFO | started process screenshot
16:36:22     INFO - TEST-INFO | screenshot: exit 0
16:36:22     INFO - TEST-UNEXPECTED-FAIL | layout/svg/tests/test_filter_crossorigin.html | reftest comparison: == Testcase loaded from mochi.test Reference: black/yellow 
16:36:22     INFO -     SimpleTest.ok@SimpleTest/SimpleTest.js:275:7
16:36:22     INFO -     assertSnapshots@SimpleTest/WindowSnapshot.js:63:3
16:36:22     INFO -     run@layout/svg/tests/test_filter_crossorigin.html:35:3
16:36:22     INFO -     onload@layout/svg/tests/test_filter_crossorigin.html:1:1
16:36:22    ERROR - GECKO(7088) | REFTEST TEST-UNEXPECTED-FAIL | Testcase loaded from mochi.test | image comparison (==), max difference: 255, number of differing pixels: 22450
16:36:22     INFO - GECKO(7088) | REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAASwAAACWCAYAAABkW7XSAAAChklEQVR4nO3UoQ0AMBADsey/dLtCWPSSgfmhS5LXeA9gK4YFXGFYwBmGBZxhWMAZWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtLIOAGhlHQDQyjoAoJV1AEAr6wCAVtYBAK2sAwBaWQcAtD79eQPQuJjDkQAAAABJRU5ErkJggg==
16:36:22     INFO - GECKO(7088) | REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAASwAAACWCAYAAABkW7XSAAACUElEQVR4nO3OoQ3AQBAEseu/6U8Ly0aRDMx9d/cAfiIPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMAqDwCs8gDAKg8ArPIAwCoPAKzyAMDmvXsAf3B1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBgdXUAYHV1AGB1dQBg9QHvpkTzOnD5AAAAAABJRU5ErkJggg==
16:36:22     INFO - TEST-PASS | layout/svg/tests/test_filter_crossorigin.html | reftest comparison: == Testcase loaded from example.org Reference: yellow/black 
16:36:22     INFO - GECKO(7088) | MEMORY STAT | vsize 1406MB | vsizeMaxContiguous 130255544MB | residentFast 83MB | heapAllocated 16MB
16:36:22     INFO - TEST-OK | layout/svg/tests/test_filter_crossorigin.html | took 86ms
16:36:22     INFO - TEST-START | Shutdown
16:36:22     INFO - Passed:  7
16:36:22     INFO - Failed:  1
16:36:22     INFO - Todo:    0
16:36:22     INFO - Mode:    e10s
16:36:22     INFO - Slowest: 1160ms - /tests/layout/svg/tests/test_filter_crossorigin.html
16:36:22     INFO - TEST-INFO | Ran 4 Loops
16:36:22     INFO - SimpleTest FINISHED
16:36:22     INFO - GECKO(7088) | [Parent 3840, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - GECKO(7088) | [Parent 3840, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - GECKO(7088) | [Child 1316, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - GECKO(7088) | [Child 1316, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - GECKO(7088) | [Parent 3840, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - GECKO(7088) | [Parent 3840, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 166
16:36:22     INFO - GECKO(7088) | 1545410182422	Marionette	TRACE	Received observer notification xpcom-will-shutdown
16:36:22     INFO - GECKO(7088) | 1545410182422	Marionette	INFO	Stopped listening on port 2828
16:36:22     INFO - GECKO(7088) | 1545410182422	Marionette	DEBUG	Remote service is inactive
16:36:22     INFO - GECKO(7088) | [RDD 5756, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 332
16:36:22     INFO - TEST-INFO | Main app process: exit 0
16:36:22     INFO - runtests.py | Application ran for: 0:00:04.817000
16:36:22     INFO - zombiecheck | Reading PID log: c:\users\task_1545409651\appdata\local\temp\tmpknayrnpidlog
16:36:22     INFO - ==> process 3840 launched child process 7776 ("Z:\task_1545409651\build\application\firefox\firefox.exe" -contentproc --channel="3840.0.1526670551\1189025101" -parentBuildID 20181221152715 -greomni "Z:\task_1545409651\build\application\firefox\omni.ja" -appomni "Z:\task_1545409651\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1545409651\build\application\firefox\browser" - "C:\Users\task_1545409651\AppData\LocalLow\Mozilla\Temp-{352eb567-c05f-4bad-a5f1-2a802612cc7d}" 3840 "\\.\pipe\gecko-crash-server-pipe.3840" 1152 gpu)
16:36:22     INFO - ==> process 3840 launched child process 5756 ("Z:\task_1545409651\build\application\firefox\firefox.exe" -contentproc --channel="3840.1.1564525716\1757416650" -parentBuildID 20181221152715 -greomni "Z:\task_1545409651\build\application\firefox\omni.ja" -appomni "Z:\task_1545409651\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1545409651\build\application\firefox\browser" - "C:\Users\task_1545409651\AppData\LocalLow\Mozilla\Temp-{352eb567-c05f-4bad-a5f1-2a802612cc7d}" 3840 "\\.\pipe\gecko-crash-server-pipe.3840" 2616 rdd)
16:36:22     INFO - ==> process 3840 launched child process 7520 ("Z:\task_1545409651\build\application\firefox\firefox.exe" -contentproc --channel="3840.8.1187252712\884623844" -childID 1 -isForBrowser -prefsHandle 2464 -prefMapHandle 2828 -prefsLen 1 -prefMapSize 190286 -schedulerPrefs 0001,2 -parentBuildID 20181221152715 -greomni "Z:\task_1545409651\build\application\firefox\omni.ja" -appomni "Z:\task_1545409651\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1545409651\build\application\firefox\browser" - 3840 "\\.\pipe\gecko-crash-server-pipe.3840" 2936 tab)
16:36:22     INFO - ==> process 3840 launched child process 772 ("Z:\task_1545409651\build\application\firefox\firefox.exe" -contentproc --channel="3840.16.1990456383\363894063" -childID 2 -isForBrowser -prefsHandle 2828 -prefMapHandle 2928 -prefsLen 1 -prefMapSize 190286 -schedulerPrefs 0001,2 -parentBuildID 20181221152715 -greomni "Z:\task_1545409651\build\application\firefox\omni.ja" -appomni "Z:\task_1545409651\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1545409651\build\application\firefox\browser" - 3840 "\\.\pipe\gecko-crash-server-pipe.3840" 2960 tab)
16:36:22     INFO - ==> process 3840 launched child process 1316 ("Z:\task_1545409651\build\application\firefox\firefox.exe" -contentproc --channel="3840.24.1069053059\312482497" -childID 3 -isForBrowser -prefsHandle 3180 -prefMapHandle 3184 -prefsLen 1 -prefMapSize 190286 -schedulerPrefs 0001,2 -parentBuildID 20181221152715 -greomni "Z:\task_1545409651\build\application\firefox\omni.ja" -appomni "Z:\task_1545409651\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1545409651\build\application\firefox\browser" - 3840 "\\.\pipe\gecko-crash-server-pipe.3840" 3172 tab)
16:36:22     INFO - zombiecheck | Checking for orphan process with PID: 7776
16:36:22     INFO - zombiecheck | Checking for orphan process with PID: 7520
16:36:22     INFO - zombiecheck | Checking for orphan process with PID: 5756
16:36:22     INFO - zombiecheck | Checking for orphan process with PID: 772
16:36:22     INFO - zombiecheck | Checking for orphan process with PID: 1316
16:36:22     INFO - Stopping web server
16:36:22     INFO - Stopping web socket server
16:36:22     INFO - Stopping ssltunnel
16:36:22  WARNING - leakcheck | refcount logging is off, so leaks can't be detected!
16:36:22     INFO - runtests.py | Running tests: end.
16:36:22     INFO - Buffered messages finished
16:36:22     INFO -  0 INFO TEST-START | Shutdown
16:36:22     INFO -  1 INFO Passed:  19
16:36:22     INFO -  2 INFO Failed:  1
16:36:22     INFO -  3 INFO Todo:    0
16:36:22     INFO -  4 INFO Mode:    e10s
16:36:22     INFO -  5 INFO SimpleTest FINISHED
16:36:22     INFO - Buffered messages finished
16:36:22     INFO - SUITE-END | took 5s
16:36:22     INFO - SUITE-START | Running 1 tests
16:36:22     INFO - :::
16:36:22     INFO - ::: Test verification summary for:
16:36:22     INFO - :::
16:36:22     INFO - ::: layout/svg/tests/test_filter_crossorigin.html
16:36:22     INFO - :::
16:36:22     INFO - ::: 1. Run each test 10 times in one browser. : FAIL
16:36:22     INFO - ::: 2. Run each test 5 times in a new browser each time. : not run / incomplete
16:36:22     INFO - ::: 3. Run each test 10 times in one browser, in chaos mode. : not run / incomplete
16:36:22     INFO - ::: 4. Run each test 5 times in a new browser each time, in chaos mode. : not run / incomplete
16:36:22     INFO - :::
16:36:22     INFO - ::: Test verification FAILED!
16:36:22     INFO - :::
16:36:22     INFO - Buffered messages finished
16:36:22     INFO - SUITE-END | took 0s
16:36:22     INFO - Return code: 0
16:36:22     INFO - TinderboxPrint: mochitest-plain<br/>5/<em class="testfail">1</em>/0
16:36:22    ERROR - # TBPL FAILURE #
16:36:22  WARNING - setting return code to 2
16:36:22    ERROR - TinderboxPrint: Per-test run of ...\tests\test_filter_crossorigin.html<br/>: FAILURE
16:36:22     INFO - Per-test suites: {}
16:36:22     INFO - Per-test suites: {}
In the failure reftest snapshots, the "test" snapshot (the iframe loaded from mochi.test) shows a tiny black area in the top-left of a fully-yellow area.  So basically, there's a black rect at the correct position, but it's much too small.

I don't know why the black area would be present but much-too-small...  The file being loaded is here, FWIW:
https://hg.mozilla.org/integration/autoland/file/0987791fff8d/layout/svg/tests/file_filter_crossorigin.svg
There was another failure for the other test-iframe, too (the one with origin "example.org"):
> INFO - TEST-UNEXPECTED-FAIL | layout/svg/tests/test_filter_crossorigin.html |
>  reftest comparison: == Testcase loaded from example.org Reference: yellow/black

Log URL: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=218354619

In that one, the testcase rendering is fully yellow (which makes a bit more sense -- that just means we failed to resolve (or render) the filter.  Perhaps there's a race condition involved here that the test needs to account for...
I did manage to locally reproduce a failure like comment 0/comment 2 here, when running
  ./mach mochitest --verify layout/svg/tests/test_filter_crossorigin.html
But I've only seen that failure once in several runs of this ^^^ command.  (When it happened, it happened right away in the very first batch of the command's testruns, I think.)

Anyway: based on the weird sizing, I'm guessing that percent-size-resolution might be part of the problem here (i.e. maybe there's a dummy viewport size for the very first layout, or something?)  To rule out that possibility, I'm testing a test-tweak that adjusts the rects here to use pixel-valued sizes & positions.

If the Try "test-verify-e10s" job does what I think it should, then this test-tweak should be getting tested here:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=5750cd90d41a396508ca0fd0e6333c779341b1c8

(I noticed the Test-Verify job was the one that had the reported failures here, so I'm hoping that I can get that to run on Try.)
Flags: needinfo?(dholbert)
The Try "TV" runs seems to like the test, with that patch (and I verified that the test name is being run in the logs there).

So, I pushed it to inbound, as a followup-patch on bug 695385 (landing in bug 695385 comment 13).   Please reopen this bug if the failures persist after that commit.
Status: NEW → RESOLVED
Closed: 5 years ago
Flags: needinfo?(dholbert)
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.