1121480 - test_wheel-default_actions.html fails on osx 10.10 with default "automatically" scrollbar prefs

Status: NEW

(Core :: DOM: Events, defect, P5)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

we are just starting to get tests going on 10.10, on mochitest-2 we have a failure (http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/cedar-macosx64/1421100530/cedar_yosemite_test-mochitest-2-bm107-tests1-macosx-build1.txt.gz):
04:15:13     INFO -  437 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to right when scrollLeft is already right-most (pixel): unexpected scrollLeft
04:15:13     INFO -  438 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  439 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to top (page): unexpected scrollTop - got 2800, expected 0
04:15:13     INFO -  440 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to top (page): unexpected scrollLeft
04:15:13     INFO -  441 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  442 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to top when scrollTop is already top-most (page): unexpected scrollTop - got 2800, expected 0
04:15:13     INFO -  443 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to top when scrollTop is already top-most (page): unexpected scrollLeft
04:15:13     INFO -  444 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  445 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to bottom (page): unexpected scrollTop - got 0, expected 2800
04:15:13     INFO -  446 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to bottom (page): unexpected scrollLeft
04:15:13     INFO -  447 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  448 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to bottom when scrollTop is already bottom-most (page): unexpected scrollTop - got 0, expected 2800
04:15:13     INFO -  449 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to bottom when scrollTop is already bottom-most (page): unexpected scrollLeft
04:15:13     INFO -  450 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  451 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to left (page): unexpected scrollTop
04:15:13     INFO -  452 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to left (page): unexpected scrollLeft - got 2800, expected 0
04:15:13     INFO -  453 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:13     INFO -  454 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to left when scrollLeft is already left-most (page): unexpected scrollTop
04:15:13     INFO -  455 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to left when scrollLeft is already left-most (page): unexpected scrollLeft - got 2800, expected 0
04:15:13     INFO -  456 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:14     INFO -  457 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to right (page): unexpected scrollTop
04:15:14     INFO -  458 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to right (page): unexpected scrollLeft - got 0, expected 2800
04:15:14     INFO -  459 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:14     INFO -  460 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to right when scrollLeft is already right-most (page): unexpected scrollTop
04:15:14     INFO -  461 INFO TEST-UNEXPECTED-FAIL | dom/events/test/test_wheel_default_action.html | doTestWholeScroll, try whole-scroll to right when scrollLeft is already right-most (page): unexpected scrollLeft - got 0, expected 2800
04:15:14     INFO -  462 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged
04:15:14     INFO -  463 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestActionOverride(action=1, override_x=-1, deltaX=1, deltaY=1): not scrolled down, got 1016
04:15:14     INFO -  464 INFO TEST-PASS | dom/events/test/test_wheel_default_action.html | doTestActionOverride(action=1, override_x=-1, deltaX=1, deltaY=1): not scrolled to right, got 1008
04:15:14     INFO -  465 INFO TEST-FAIL | dom/events/test/test_wheel_default_action.html | The author of the test has indicated that flaky timeouts are expected.  Reason: untriaged

This test was added in bug 719320 in July 2012.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Masayuki, can you look into this failure?  It would be nice to get some ideas from you on why this is happening.  Feel free to divert to anyone else who could help out as well.

Comment 2

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)]

Very odd... The test is completely testing XP level code. I don't know why this fails on specific platform. Does this fail when it runs alone?

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

I have no idea, my only way to test is via the cedar branch:
https://tbpl.mozilla.org/?tree=Cedar&jobname=Rev5%20MacOSX%20Yosemite%2010.10%20cedar&rev=45563790949b

Kim, do you know anyone who can test this locally, or if getting a 10.10 loaner is possible?

Comment 4

[Kim Moir [:kmoir] ET]

I can take one of the 10.10 machines out of the pool and loan it to masayuki, would that work?

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

that sounds logical.

Comment 6

[Phil Ringnalda (:philor)]

(In reply to Masayuki Nakano (:masayuki) (Mozilla Japan) from comment #2)
> Very odd... The test is completely testing XP level code. I don't know why
> this fails on specific platform. Does this fail when it runs alone?

Yes, I get the same set of failures while running just this test locally on 10.10.

Comment 8

[Phil Ringnalda (:philor)]

But, just like with the three tests in bug 1121505, if I run it with the non-default system preference to "show scrollbars: always" (which is what we thought we had set on the 10.10 slaves), it passes.

Comment 9

[Kim Moir [:kmoir] ET]

jmaher, masayuki: You can now run these on try now that bug 1122039 is in production, for example to run m-2 for this bug
  try: -b do -p macosx64 -u mochitest-2[10.10] -t none

Comment 10

[Phil Ringnalda (:philor)]

No longer blocks deploying 10.10, since actually successfully setting the non-default pref for always on scrollbars stops the test failure, but we'd still like to see it fixed someday somehow, since we don't want to have to set that pref in automation forever, and we don't want to have to tell individuals running tests locally that they have to set a non-default system pref to have tests pass.

Comment 11

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)]

That sounds odd. If scrollbar settings in system level affect our XP scrollbar handling, there should be unexpected bug because this test checks the result of wheel event handling, not scrollbar's behavior.

Comment 12

[Firefox Bug Husbandry Bot]

https://bugzilla.mozilla.org/show_bug.cgi?id=1472046

Move all DOM bugs that haven’t been updated in more than 3 years and has no one currently assigned to P5.

If you have questions, please contact :mdaly.