947690 - Permaorange: test_bug571352.html fails to select options on 10.10

Status: RESOLVED FIXED

(Core :: Layout: Form Controls, defect, P5)

Description

[Phil Ringnalda (:philor)]

Among the possibilities is that this is from some general test problem with scrollbars on 10.9 that I haven't quite made sense of.

https://tbpl.mozilla.org/php/getParsedLog.php?id=31634640&tree=Cedar
Rev5 MacOSX Mavericks 10.9 cedar opt test mochitest-5 on 2013-12-07 16:45:02 PST for push de1a3b3fbf4e
slave: t-mavericks-r5-001

16:47:00     INFO -  314 INFO TEST-PASS | /tests/layout/forms/test/test_bug571352.html | <select> is focused
16:47:00     INFO -  315 ERROR TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected
16:47:00     INFO -  316 ERROR TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first three options are selected
16:47:00     INFO -  317 ERROR TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected

Comment 1

[Phil Ringnalda (:philor)]

It's only P5 if you want to lose this test on OS X > 10.6 - releng is going to get rid of 10.8 and move to 10.9, whether we fix the tests or we disable them.

Comment 2

[Geoff Brown [:gbrown]]

This remains a consistent failure on 10.9, on Cedar:

https://tbpl.mozilla.org/php/getParsedLog.php?id=46507077&tree=Cedar&full=1#error0

15:48:12     INFO -  2397 INFO TEST-START | /tests/layout/forms/test/test_bug571352.html
15:48:13     INFO -  2398 INFO dumping last 2 message(s)
15:48:13     INFO -  2399 INFO if you need more context, please use SimpleTest.requestCompleteLog() in your test
15:48:13     INFO -  2400 INFO must wait for load
15:48:13     INFO -  2401 INFO TEST-PASS | /tests/layout/forms/test/test_bug571352.html | <select> is focused
15:48:13     INFO -  2402 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected
15:48:13     INFO -  TEST-INFO | expected PASS
15:48:13     INFO -  2403 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first three options are selected
15:48:13     INFO -  TEST-INFO | expected PASS
15:48:13     INFO -  2404 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected
15:48:13     INFO -  TEST-INFO | expected PASS
15:48:13     INFO -  2405 INFO TEST-OK | /tests/layout/forms/test/test_bug571352.html | took 54ms


Also on 10.9 Debug: https://tbpl.mozilla.org/php/getParsedLog.php?id=46387870&tree=Cedar&full=1#error0

13:08:24     INFO -  394 INFO TEST-START | /tests/layout/forms/test/test_bug571352.html
13:08:24     INFO -  395 INFO ++DOMWINDOW == 38 (0x116308000) [pid = 1502] [serial = 86] [outer = 0x123412000]
13:08:25     INFO -  396 INFO dumping last 2 message(s)
13:08:25     INFO -  397 INFO if you need more context, please use SimpleTest.requestCompleteLog() in your test
13:08:25     INFO -  398 INFO must wait for load
13:08:25     INFO -  399 INFO TEST-PASS | /tests/layout/forms/test/test_bug571352.html | <select> is focused
13:08:25     INFO -  400 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected
13:08:25     INFO -  TEST-INFO | expected PASS
13:08:25     INFO -  401 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first three options are selected
13:08:25     INFO -  TEST-INFO | expected PASS
13:08:25     INFO -  402 INFO TEST-UNEXPECTED-FAIL | /tests/layout/forms/test/test_bug571352.html | first two options are selected
13:08:25     INFO -  TEST-INFO | expected PASS
13:08:25     INFO -  403 INFO TEST-OK | /tests/layout/forms/test/test_bug571352.html | took 725ms

Comment 4

[Phil Ringnalda (:philor)]

New version, same as the old.

Well, one difference: this time, we're not going to just sit around for months or years, so this test is nearly certain to no longer be run on OS X other than for however long 10.6 testing sticks around.

Comment 5

[Phil Ringnalda (:philor)]

Disabled on 10.10 in https://hg.mozilla.org/integration/mozilla-inbound/rev/32babf78aee8

Comment 6

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/32babf78aee8

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

The leave-open keyword is there and there is no activity for 6 months.
:svoisen, maybe it's time to close this bug?

Comment 8

[Sean Voisen (:svoisen)]

Phil or Mats: Any reason to leave this open (now that we're well beyond 10.10 these days ...)?

Comment 9

[Phil Ringnalda (:philor)]

Over 10.10? No, I don't think I'll ever get over 10.10.

We're still using 10.10 as our only Mac version in integration testing, so this is still open because we don't run this test Mac at all.

Your triage choices as far as I know them are:

* get someone to see whether or not it still fails, and if it still fails to look at why it fails, and if it fails for good and just cause because we never will be able to run it on Mac to change the annotation from version-specific to just the OS, dropping the mention of a bug, and let that patch close this bug, or if it fails for some other reason address that reason

* just admit that we don't care in the least whether or not we have an open bug for a test failure that we have never examined, and resolve this bug "Inactive"

* ask the Release mgmt bot what can be done to get it to shut up about a bug which is open because it is a valid bug, whether or not someone has touched it in the last 6 months

Comment 10

[Mats Palmgren (inactive)]

So the issue here is that on OSX the <select> list has an overlay scrollbar that
briefly shows up and then fades away.  The <option> text is just one character
wide and the scrollbar covers most of it, so the mouse click events in the test
(at x=5,y=5) is captured by the scrollbar before it fades away.

Just making the <select> wider to get the scrollbar out of the way should fix it:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=6028eb0d3e257b15d8073afb9d4f5a3227938a1e

Comment 11

[Mats Palmgren (inactive)]

Attachment: fix the test and enable it

Comment 12

[Phil Ringnalda (:philor)]

Comment on attachment 9029839 [details] [diff] [review]
fix the test and enable it

Thank you!

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/0bbaefec570b
Make the <select> wider to avoid any overlay scrollbar messing with the mouse events in the test. (TEST-ONLY) r=philor

Comment 14

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/0bbaefec570b