444674 - clobber qm-win2k3-moz2-01 and qm-win2k3-03 again to try to resolve MochiTest failures

Status: VERIFIED FIXED

(Infrastructure & Operations :: RelOps: General, task)

Description

[Myk Melez [:myk] [@mykmelez]]

After qm-win2k3-moz2-01 and qm-win2k3-03 were clobbered today per bug 444636 to resolve an earlier problem, they started failing with the following 45 MochiTest failures:

*** 12374 ERROR FAIL | (15,35) IDs should match (upper left corner of txt) | got [object HTMLSpanElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12375 ERROR FAIL | (209,59) IDs should match (lower right corner of txt) | got [object HTMLDivElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12376 ERROR FAIL | (15,71) IDs should match (upper left corner of empty) | got [object HTMLDivElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12377 ERROR FAIL | (209,85) IDs should match (lower right corner of empty) | got [object HTMLDivElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12378 ERROR FAIL | (15,97) IDs should match (upper left corner of whitespace) | got [object HTMLDivElement], expected [object HTMLParagraphElement] | /tests/content/html/document/test/test_bug199692.html
*** 12379 ERROR FAIL | (501,111) IDs should match (lower right corner of whitespace) | got [object HTMLDivElement], expected [object HTMLParagraphElement] | /tests/content/html/document/test/test_bug199692.html
*** 12380 ERROR FAIL | (15,122) IDs should match (upper left corner of static) | got [object HTMLIFrameElement], expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12381 ERROR FAIL | (40,135) IDs should match (lower right corner of static) | got [object HTMLIFrameElement], expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12382 ERROR FAIL | (107,507) IDs should match (upper left corner of fixed) | got null, expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12383 ERROR FAIL | (303,523) IDs should match (lower right corner of fixed) | got null, expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12384 ERROR FAIL | (157,557) IDs should match (upper left corner of absolute) | got null, expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12385 ERROR FAIL | (351,571) IDs should match (lower right corner of absolute) | got null, expected [object HTMLSpanElement] | /tests/content/html/document/test/test_bug199692.html
*** 12386 ERROR FAIL | (15,351) IDs should match (upper left corner of relative) | got [object HTMLHtmlElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12387 ERROR FAIL | (209,365) IDs should match (lower right corner of relative) | got [object HTMLHtmlElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12388 ERROR FAIL | (307,125) IDs should match (upper left corner of float) | got [object HTMLIFrameElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12389 ERROR FAIL | (501,139) IDs should match (lower right corner of float) | got [object HTMLDivElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12390 ERROR FAIL | (327,293) IDs should match (upper left corner of textbox) | got [object HTMLIFrameElement], expected [object HTMLInputElement] | /tests/content/html/document/test/test_bug199692.html
*** 12391 ERROR FAIL | (463,309) IDs should match (lower right corner of textbox) | got [object HTMLIFrameElement], expected [object HTMLInputElement] | /tests/content/html/document/test/test_bug199692.html
*** 12396 ERROR FAIL | Hit testing should bypass hidden elements. | got [object HTMLIFrameElement], expected [object HTMLDivElement] | /tests/content/html/document/test/test_bug199692.html
*** 12397 ERROR FAIL | Element from nested iframe returned is from calling document | got [object HTMLDivElement], expected [object HTMLIFrameElement] | /tests/content/html/document/test/test_bug199692.html
*** 12398 ERROR FAIL | Element from doubly nested iframe returned is from calling document | got [object HTMLHtmlElement], expected [object HTMLIFrameElement] | /tests/content/html/document/test/test_bug199692.html
*** 51588 ERROR FAIL | popup tests are likely to fail for screen heights less than 768 pixels |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51641 ERROR FAIL | open popup anchored after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51647 ERROR FAIL | open popup anchored after_end position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51653 ERROR FAIL | open popup anchored start_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51665 ERROR FAIL | open popup anchored end_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51695 ERROR FAIL | open popup anchored with attribute after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51701 ERROR FAIL | open popup anchored with attribute after_end position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51707 ERROR FAIL | open popup anchored with attribute start_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51719 ERROR FAIL | open popup anchored with attribute end_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51760 ERROR FAIL | show popup anchored start_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51772 ERROR FAIL | show popup anchored end_before position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51790 ERROR FAIL | show popup anchored after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51802 ERROR FAIL | show popup anchored after_end position |  | /tests/toolkit/content/tests/widgets/test_popup_attribute.xul
*** 51923 ERROR FAIL | popup tests are likely to fail for screen heights less than 768 pixels |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 51932 ERROR FAIL | mouse click on trigger after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 51984 ERROR FAIL | open popup anchored after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 51991 ERROR FAIL | open popup anchored after_end position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 51998 ERROR FAIL | open popup anchored start_before position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52012 ERROR FAIL | open popup anchored end_before position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52047 ERROR FAIL | open popup anchored with attribute after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52054 ERROR FAIL | open popup anchored with attribute after_end position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52061 ERROR FAIL | open popup anchored with attribute start_before position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52075 ERROR FAIL | open popup anchored with attribute end_before position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul
*** 52217 ERROR FAIL | open popup with open property after_start position |  | /tests/toolkit/content/tests/widgets/test_popup_button.xul

There were four checkins between the previous build and the one that first showed these failures, so I had folks back out those four changes.  But that didn't make a difference.  So apparently this is not due to checkins.  Perhaps it's a result of the earlier clobber?  That doesn't sound likely, but I don't have any other explanation.

In any case, perhaps another clobber will fix things.  I can't think of anything else to do.

Comment 1

[chizu]

Clobbered both, we'll see if that helps.

Comment 2

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

The 45 failures that are showing up are popup-related.  This makes it look like they're occurring because focus was left in the wrong place after the last clobber.

Comment 3

[Myk Melez [:myk] [@mykmelez]]

Both machines failed again on the same 45 MochiTests.  I chatted with Reed on IRC, and he says that when clobbering the terminal window in which the build is being run should be the only open window, and that window should be minimized.

Trevor: was that the state of the system for these clobbers?

Comment 4

[chizu]

For all of the clobbers done, the cmd window was the only open window and it was minimized before I disconnected from rdesktop.

Comment 5

[Myk Melez [:myk] [@mykmelez]]

Ok, escalating to the build team.  I looked for members in the office, but there weren't any (although some may be returning from dinner shortly).  According to the docs <http://wiki.mozilla.org/Unittest:Win2k3:Moz2:ITSupport> the next step, restarting the farm, requires us to first contact robcee and bhearsum, so cc:ing them on this bug.

Comment 6

[chizu]

Gave robcee a call, he said the window might still have focus despite being minimized. Going to try clicking away from the task bar and running another build.

Comment 7

[Lukas Blakk [:lsblakk] use ?needinfo]

Did a clobber build on these.

Clobbering on windows has to include:

rmdir /s /q /builds/slave/win2k3  (or whatever the build dir is called)

Windows doesn't like to have slaves interrupted and after a failed build, it needs a clean checkout and compile it seems.


Closing this one.  Fire's out.

Comment 8

[Myk Melez [:myk] [@mykmelez]]

Yup, that did the trick.  Thanks!