Last Comment Bug 755025 - Intermittent REFTEST TEST-UNEXPECTED-FAIL | xulscroll.html and/or textbox-setsize.xul | image comparison (==)
: Intermittent REFTEST TEST-UNEXPECTED-FAIL | xulscroll.html and/or textbox-set...
Status: RESOLVED FIXED
: intermittent-failure
Product: Core
Classification: Components
Component: Layout (show other bugs)
: 15 Branch
: x86 Windows 7
: -- normal (vote)
: mozilla15
Assigned To: Mats Palmgren (:mats)
:
:
Mentors:
Depends on: 755955
Blocks: 438871
  Show dependency treegraph
 
Reported: 2012-05-14 14:11 PDT by Matt Brubeck (:mbrubeck)
Modified: 2012-11-25 19:31 PST (History)
4 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---


Attachments
wallpaper (4.98 KB, patch)
2012-05-15 04:39 PDT, Mats Palmgren (:mats)
roc: review+
Details | Diff | Splinter Review

Description Matt Brubeck (:mbrubeck) 2012-05-14 14:11:07 PDT
Looks like a focus or mouse hover issue.  In scrollbox.html one of the scrollbars in image 1 is highlighted, while in image 2 none of them are.  In textbox-setsize.xul, the textbox in image 1 has its border highlighted in blue, while image 2 has a grey border.

https://tbpl.mozilla.org/php/getParsedLog.php?id=11732043&tree=Mozilla-Inbound
Rev3 WINNT 6.1 mozilla-inbound opt test reftest-no-accel on 2012-05-14 11:55:54 PDT for push b001da365ab7
slave: talos-r3-w7-023

REFTEST INFO | Loading a blank page
REFTEST TEST-START | http://localhost:4444/1337022016745/188/text-overflow/xulscroll.html | 3522 / 7608 (46%)
REFTEST TEST-START | http://localhost:4444/1337022016745/188/text-overflow/xulscroll-ref.html | 3522 / 7608 (46%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST number of differing pixels: 2548 max difference: 106
REFTEST INFO | Loading a blank page

REFTEST INFO | Loading a blank page
REFTEST TEST-START | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | 4222 / 7608 (55%)
REFTEST TEST-START | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize-ref.xul | 4222 / 7608 (55%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST number of differing pixels: 2000 max difference: 84
REFTEST INFO | Saved log: START file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Saved log: START file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize-ref.xul
REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
REFTEST INFO | Saved log: Initializing canvas snapshot
REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
REFTEST INFO | Saved log: [CONTENT] RecordResult fired
REFTEST INFO | Saved log: RecordResult fired
REFTEST INFO | Loading a blank page

https://tbpl.mozilla.org/php/getParsedLog.php?id=11734449&tree=Firefox
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2012-05-14 13:11:13 PDT for push 498d2784a240
slave: talos-r3-w7-031

REFTEST INFO | Loading a blank page
REFTEST TEST-START | http://localhost:4444/1337026372491/188/text-overflow/xulscroll.html | 3522 / 7608 (46%)
REFTEST TEST-START | http://localhost:4444/1337026372491/188/text-overflow/xulscroll-ref.html | 3522 / 7608 (46%)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST number of differing pixels: 2458 max difference: 106
REFTEST INFO | Loading a blank page
Comment 1 Mats Palmgren (:mats) 2012-05-14 14:34:36 PDT
AFAIK, the reftest framework doesn't guarantee that the synthetic mouse event
that triggers :hover on document load has been run, so I suppose there's a race
between that and the snapshot being taken.  We should probably fix this in the
framework somehow.
Comment 2 Robert O'Callahan (:roc) (email my personal email if necessary) 2012-05-14 15:34:02 PDT
If the tests aren't supposed to be testing hover, the best thing to do is to set styles on the tests so that they don't respond to hover. That way they won't fail when someone is running tests locally and accidentally moves the mouse over the window.
Comment 3 Mats Palmgren (:mats) 2012-05-14 16:32:17 PDT
Hmm, is there a way to get a non-themed scrollbar for a <div>?
I tried "div { -moz-appearance: none; }" but it didn't have any effect.

I still regard this as a bug in the reftest framework - it should run
the test and the reference in exactly the same way.
Comment 4 Treeherder Robot 2012-05-14 18:17:07 PDT
bbondy
https://tbpl.mozilla.org/php/getParsedLog.php?id=11731982&tree=Try
Rev3 WINNT 6.1 try opt test reftest on 2012-05-14 11:56:16
slave: talos-r3-w7-017

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/native-theme/textarea-nonnative-when-styled.html | image comparison (==)
Comment 5 Treeherder Robot 2012-05-14 19:25:01 PDT
philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=11734425&tree=Fx-Team
Rev3 WINNT 6.1 fx-team opt test reftest-no-accel on 2012-05-14 13:00:22
slave: talos-r3-w7-023

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
Comment 6 Mats Palmgren (:mats) 2012-05-15 04:39:45 PDT
Created attachment 623997 [details] [diff] [review]
wallpaper

https://tbpl.mozilla.org/?usebuildbot=1&tree=Try&rev=2002a074e86e
(the Android R3 oranges are unrelated)
Comment 7 Treeherder Robot 2012-05-15 06:03:15 PDT
edmorley
https://tbpl.mozilla.org/php/getParsedLog.php?id=11761168&tree=Fx-Team
Rev3 WINNT 6.1 fx-team opt test reftest on 2012-05-15 05:19:55
slave: talos-r3-w7-005

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
Comment 8 Treeherder Robot 2012-05-15 06:37:20 PDT
jwalker%mozilla.com
https://tbpl.mozilla.org/php/getParsedLog.php?id=11761308&tree=Try
Rev3 WINNT 6.1 try opt test reftest on 2012-05-15 05:25:40
slave: talos-r3-w7-065

REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/text-overflow/xulscroll.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/forms/textbox-setsize.xul | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/test/build/reftest/tests/layout/reftests/native-theme/textarea-nonnative-when-styled.html | image comparison (==)
Comment 9 Mats Palmgren (:mats) 2012-05-16 16:33:12 PDT
https://hg.mozilla.org/integration/mozilla-inbound/rev/7cf218423f9c

Filed follow-up bug 755955.
Comment 10 Ed Morley [:emorley] 2012-05-17 03:16:33 PDT
https://hg.mozilla.org/mozilla-central/rev/7cf218423f9c

Note You need to log in before you can comment on or make changes to this bug.