Closed Bug 1178062 Opened 4 years ago Closed 4 years ago

Several SVG "conditions-*.svg" reftests fail on Mulet following changes in the reftest chunking boundary

Categories

(Core :: SVG, defect)

defect
Not set

Tracking

()

RESOLVED FIXED
mozilla41
Tracking Status
firefox41 --- fixed

People

(Reporter: jfkthame, Assigned: jfkthame)

Details

This test started failing recently, see https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=89a655d70378:

 REFTEST TEST-UNEXPECTED-FAIL | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-05.svg | image comparison (==), max difference: 102, number of differing pixels: 80 

The curious thing is that until this push, the Mulet R5 job was finishing just prior to this test. From the preceding push:

16:50:00     INFO -  REFTEST TEST-START | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-03.svg
16:50:00     INFO -  REFTEST TEST-LOAD | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-03.svg | 1974 / 1975 (99%)
16:50:00     INFO -  REFTEST TEST-PASS | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-03.svg | image comparison (==)
16:50:00     INFO -  REFTEST INFO | Loading a blank page
16:50:00     INFO -  REFTEST TEST-END | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-03.svg
16:50:00     INFO -  REFTEST FINISHED: Slowest test took 1018ms (file:///home/worker/build/tests/reftest/tests/layout/reftests/selection/splitText-normalize-ref.html)

So then conditions-05.svg was being run in the R6 chunk:

16:46:22     INFO -  REFTEST INFO | Running chunk 6 out of 6 chunks.  tests 10396-12547/2152
16:46:22     INFO -  REFTEST TEST-START | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-04.svg
16:46:22     INFO -  REFTEST TEST-LOAD | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-04.svg | 0 / 2152 (0%)
16:46:22     INFO -  REFTEST INFO | [CONTENT] Using browser remote=false
run tasks
16:46:22     INFO -  REFTEST INFO | drawWindow flags = DRAWWINDOW_DRAW_CARET | DRAWWINDOW_DRAW_VIEW | DRAWWINDOW_USE_WIDGET_LAYERS; window size = 800,1000; test browser size = 800,1000
16:46:22     INFO -  REFTEST TEST-LOAD | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/pass.svg | 0 / 2152 (0%)
16:46:22     INFO -  REFTEST TEST-PASS | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-04.svg | image comparison (==)
16:46:22     INFO -  REFTEST INFO | Loading a blank page
16:46:22     INFO -  REFTEST TEST-END | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-04.svg
16:46:22     INFO -  REFTEST TEST-START | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-05.svg
16:46:22     INFO -  REFTEST TEST-LOAD | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-05.svg | 1 / 2152 (0%)
16:46:22     INFO -  REFTEST TEST-LOAD | about:blank | 1 / 2152 (0%)

16:46:22     INFO -  REFTEST TEST-PASS | file:///home/worker/build/tests/reftest/tests/layout/reftests/svg/conditions-05.svg | image comparison (==)
16:46:22     INFO -  REFTEST INFO | Loading a blank page

And there, it passed fine.

I'm going to mark it random, given that its success apparently depends on the vagaries of reftest chunking.
Summary: reftest conditions-05.svg fails on Mulet → reftest conditions-05.svg fails on Mulet after a change in the reftest chunking boundary
After the landing of bug 1173958, which added more reftests and hence shifted the chunking again, several more of these *-conditions-*.svg tests are failing similarly. All the affected tests are comparing the testcase to about:blank, and the difference seems to be the scrollbar. (Why is there a scrollbar at all?)

Marking more tests as random....
Summary: reftest conditions-05.svg fails on Mulet after a change in the reftest chunking boundary → Several SVG "conditions-*.svg" reftests fail on Mulet following changes in the reftest chunking boundary
https://hg.mozilla.org/mozilla-central/rev/6f934ce6814c
https://hg.mozilla.org/mozilla-central/rev/81f4e80728ed
Assignee: nobody → jkew
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla41
Assignee: jkew → jfkthame
You need to log in before you can comment on or make changes to this bug.