750866 - Intermittent REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/text-transform/all-upper.html | image comparison (==)

Status: RESOLVED WORKSFORME

(Core :: Layout, defect)

Description

[Matt Brubeck (:mbrubeck)]

The two images use different fonts.  Image 1 is sans-serif, while Image 2 is serif.

REFTEST INFO | Loading a blank page
++DOMWINDOW == 51 (0x1161721c8) [serial = 20537] [outer = 0x104bb5130]
REFTEST TEST-START | http://localhost:4444/1335898380182/402/text-transform/all-upper.html | 7304 / 7560 (96%)
++DOMWINDOW == 52 (0x140609da8) [serial = 20538] [outer = 0x104bb5130]
WARNING: Unable to test style tree integrity -- no content node: file ../../../layout/base/nsCSSFrameConstructor.cpp, line 8001
WARNING: unable to merge across a glyph run boundary, glyph(s) discarded: '!aCharsToMerge[mergeRunStart]', file ../../../layout/generic/nsTextRunTransformations.cpp, line 235
WARNING: Unable to test style tree integrity -- no content node: file ../../../layout/base/nsCSSFrameConstructor.cpp, line 8001
REFTEST TEST-START | http://localhost:4444/1335898380182/402/text-transform/all-upper-ref.html | 7304 / 7560 (96%)
--DOMWINDOW == 51 (0x1161f0aa8) [serial = 20534] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 50 (0x13873e438) [serial = 20533] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/uppercase-ref.html]
--DOMWINDOW == 49 (0x1164225d8) [serial = 20532] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/uppercase-1.html]
--DOMWINDOW == 48 (0x1187b6b78) [serial = 20531] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 47 (0x1152f0b18) [serial = 20530] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/small-caps-1-ref.html]
--DOMWINDOW == 46 (0x138713768) [serial = 20529] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/small-caps-1.html]
--DOMWINDOW == 45 (0x1399d2ce8) [serial = 20528] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 44 (0x116113308) [serial = 20527] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/lowercase-sigma-1-ref.html]
--DOMWINDOW == 43 (0x1387cd548) [serial = 20526] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/lowercase-sigma-1.html]
--DOMWINDOW == 42 (0x11524a8e8) [serial = 20525] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 41 (0x1406e2388) [serial = 20524] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/lowercase-ref.html]
--DOMWINDOW == 40 (0x13c5a4e08) [serial = 20523] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/lowercase-1.html]
--DOMWINDOW == 39 (0x1185e7e88) [serial = 20522] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 38 (0x115200c58) [serial = 20521] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-6-ref.html]
--DOMWINDOW == 37 (0x140643178) [serial = 20520] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-6.html]
--DOMWINDOW == 36 (0x1161ccf48) [serial = 20519] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 35 (0x116442778) [serial = 20518] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-5-ref.html]
--DOMWINDOW == 34 (0x1185e91b8) [serial = 20517] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-5.html]
--DOMWINDOW == 33 (0x140676458) [serial = 20516] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 32 (0x1387a7c68) [serial = 20515] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-4-ref.html]
--DOMWINDOW == 31 (0x116194f18) [serial = 20514] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-4.html]
--DOMWINDOW == 30 (0x138743838) [serial = 20513] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 29 (0x1406c0ad8) [serial = 20512] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-3-ref.html]
--DOMWINDOW == 28 (0x1406b7d18) [serial = 20511] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-3.html]
--DOMWINDOW == 27 (0x13873a148) [serial = 20510] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 26 (0x1152c8c48) [serial = 20509] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-2.html]
--DOMWINDOW == 25 (0x138739918) [serial = 20508] [outer = 0x104bb5130] [url = data:text/html,%3C%21%2D%2DCLEAR%2D%2D%3E]
--DOMWINDOW == 24 (0x115cb8ae8) [serial = 20507] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-ref.html]
--DOMWINDOW == 23 (0x1185db8f8) [serial = 20506] [outer = 0x104bb5130] [url = file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/capitalize-1.html]
++DOMWINDOW == 24 (0x1387e9348) [serial = 20539] [outer = 0x104bb5130]
WARNING: Unable to test style tree integrity -- no content node: file ../../../layout/base/nsCSSFrameConstructor.cpp, line 8001
WARNING: Unable to test style tree integrity -- no content node: file ../../../layout/base/nsCSSFrameConstructor.cpp, line 8001
REFTEST TEST-UNEXPECTED-FAIL | file:///Users/cltbld/talos-slave/test/build/reftest/tests/layout/reftests/text-transform/all-upper.html | image comparison (==)

REFTEST number of differing pixels: 171480 max difference: 255
REFTEST INFO | Saved log: START http://localhost:4444/1335898380182/402/text-transform/all-upper.html
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Saved log: START http://localhost:4444/1335898380182/402/text-transform/all-upper-ref.html
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Loading a blank page

Comment 1

[Matt Brubeck (:mbrubeck)]

I forgot to include this in comment 0:

https://tbpl.mozilla.org/php/getParsedLog.php?id=11364450&tree=Firefox
Rev4 MacOSX Lion 10.7 mozilla-central debug test reftest on 2012-05-01 11:52:02 PDT for push 74108dd3201d
slave: talos-r4-lion-031

Comment 2

[Jonathan Kew [:jfkthame]]

The testcase and reference both use @font-face to load DejaVuSans from the layout/reftests/fonts directory. (So do the following couple of tests, all-lower.html and all-title.html.)

From the images, it seems that the font failed to load for the reference file here, so we're comparing the testcase (with correct font) against the reference (using fallback).

Looking at the log, we see a lot of "--DOMWINDOW..." lines after "REFTEST TEST-START | http://localhost:4444/1335898380182/402/text-transform/all-upper-ref.html", and before the "REFTEST TEST-UNEXPECTED-FAIL". So I think what's happened is that right after the reference load was started, GC kicked in and cleaned up a lot of windows from earlier tests; unfortunately, that took long enough that the font-loading timeout fired and the page was rendered using fallback (as per bug 499292).

I thought reftests normally waited for the resource load to finish before comparing the images?