755025 - Intermittent REFTEST TEST-UNEXPECTED-FAIL | xulscroll.html and/or textbox-setsize.xul | image comparison (==)

Status: RESOLVED FIXED

(Core :: Layout, defect)

Description

[Matt Brubeck (:mbrubeck)]

Looks like a focus or mouse hover issue.  In scrollbox.html one of the scrollbars in image 1 is highlighted, while in image 2 none of them are.  In textbox-setsize.xul, the textbox in image 1 has its border highlighted in blue, while image 2 has a grey border.

https://tbpl.mozilla.org/php/getParsedLog.php?id=11732043&tree=Mozilla-Inbound
Rev3 WINNT 6.1 mozilla-inbound opt test reftest-no-accel on 2012-05-14 11:55:54 PDT for push b001da365ab7
slave: talos-r3-w7-023

REFTEST INFO | Loading a blank page
REFTEST TEST-START | http://localhost:4444/1337022016745/188/text-overflow/xulscroll.html | 3522 / 7608 (46%)
REFTEST TEST-START | http://localhost:4444/1337022016745/188/text-overflow/xulscroll-ref.html | 3522 / 7608 (46%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST number of differing pixels: 2548 max difference: 106
REFTEST INFO | Loading a blank page

REFTEST INFO | Loading a blank page
REFTEST TEST-START | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | 4222 / 7608 (55%)
REFTEST TEST-START | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize-ref.xul | 4222 / 7608 (55%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST number of differing pixels: 2000 max difference: 84
REFTEST INFO | Saved log: START file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Saved log: START file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize-ref.xul
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Loading a blank page

https://tbpl.mozilla.org/php/getParsedLog.php?id=11734449&tree=Firefox
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2012-05-14 13:11:13 PDT for push 498d2784a240
slave: talos-r3-w7-031

REFTEST INFO | Loading a blank page
REFTEST TEST-START | http://localhost:4444/1337026372491/188/text-overflow/xulscroll.html | 3522 / 7608 (46%)
REFTEST TEST-START | http://localhost:4444/1337026372491/188/text-overflow/xulscroll-ref.html | 3522 / 7608 (46%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST number of differing pixels: 2458 max difference: 106
REFTEST INFO | Loading a blank page

Comment 1

[Mats Palmgren (inactive)]

AFAIK, the reftest framework doesn't guarantee that the synthetic mouse event
that triggers :hover on document load has been run, so I suppose there's a race
between that and the snapshot being taken.  We should probably fix this in the
framework somehow.

Comment 2

[Robert O'Callahan (:roc) (email my personal email if necessary)]

If the tests aren't supposed to be testing hover, the best thing to do is to set styles on the tests so that they don't respond to hover. That way they won't fail when someone is running tests locally and accidentally moves the mouse over the window.

Comment 3

[Mats Palmgren (inactive)]

Hmm, is there a way to get a non-themed scrollbar for a <div>?
I tried "div { -moz-appearance: none; }" but it didn't have any effect.

I still regard this as a bug in the reftest framework - it should run
the test and the reference in exactly the same way.

Comment 4

[Legacy TBPL/Treeherder Robot]

bbondy
https://tbpl.mozilla.org/php/getParsedLog.php?id=11731982&tree=Try
Rev3 WINNT 6.1 try opt test reftest on 2012-05-14 11:56:16
slave: talos-r3-w7-017

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/native-theme/textarea-nonnative-when-styled.html | image comparison (==)

Comment 5

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=11734425&tree=Fx-Team
Rev3 WINNT 6.1 fx-team opt test reftest-no-accel on 2012-05-14 13:00:22
slave: talos-r3-w7-023

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)

Comment 6

[Mats Palmgren (inactive)]

Attachment: wallpaper

https://tbpl.mozilla.org/?usebuildbot=1&tree=Try&rev=2002a074e86e
(the Android R3 oranges are unrelated)

Comment 7

[Legacy TBPL/Treeherder Robot]

edmorley
https://tbpl.mozilla.org/php/getParsedLog.php?id=11761168&tree=Fx-Team
Rev3 WINNT 6.1 fx-team opt test reftest on 2012-05-15 05:19:55
slave: talos-r3-w7-005

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)

Comment 8

[Legacy TBPL/Treeherder Robot]

jwalker%mozilla.com
https://tbpl.mozilla.org/php/getParsedLog.php?id=11761308&tree=Try
Rev3 WINNT 6.1 try opt test reftest on 2012-05-15 05:25:40
slave: talos-r3-w7-065

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/native-theme/textarea-nonnative-when-styled.html | image comparison (==)

Comment 9

[Mats Palmgren (inactive)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/7cf218423f9c

Filed follow-up bug 755955.

Comment 10

[Ed Morley [:emorley]]

https://hg.mozilla.org/mozilla-central/rev/7cf218423f9c