1062330 - Test Failure 'controller.waitForPageLoad(URI=https://www.stopbadware.org/firefox*, readyState=loading)' in /testSecurity/testSafeBrowsingNotificationBar.js

Status: RESOLVED INVALID

(Mozilla QA Graveyard :: Mozmill Tests, defect, P2)

Description

[Tracy Walker [:tracy]]

Reporting this failure from beta_remote run in /testSecurity/testSafeBrowsingNotificationBar.js

http://mozmill-release.blargon7.com/#/remote/report/12a8568e34c97b929089c7a61fc3331e

Comment 1

[Tracy Walker [:tracy]]

similar?  http://mozmill-release.blargon7.com/#/remote/report/12a8568e34c97b929089c7a61fc00faf

Comment 2

[Andrei Eftimie]

10 min apart. possible network issues on either end.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Yeah. Page is still in loading state after 30s. So I also highly suspect a network issue here.

Comment 4

[Cosmin Malutan, [:cosmin-malutan]]

Failed for 54 times, non-reproducible. 
http://mozmill-release.blargon7.com/#/remote/failure?app=Firefox&branch=All&platform=All&from=2014-10-01&to=&test=%2FtestSecurity%2FtestSafeBrowsingNotificationBar.js&func=testNotificationBar

Comment 5

[Andrei Eftimie]

We still see this failing regularly. If the server is responding but slowly we might be able to reduce this by increasing the timeout.

A bit hard to track due to other issues affecting this test:
http://mozmill-release.blargon7.com/#/remote/failure?app=Firefox&branch=All&platform=All&from=2014-09-01&test=%2FtestSecurity%2FtestSafeBrowsingNotificationBar.js&func=testNotificationBar

Comment 6

[Andrei Eftimie]

Bumping priority.

This is failing in 2 ways:
> controller.waitForPageLoad(URI=about:blank, readyState=uninitialized)
and
> controller.waitForPageLoad(URI=https://www.stopbadware.org/firefox?hl=uk&url=https%3A%2F%2Fwww.itisatrap.org%2Ffirefox%2Fits-an-attack.html, readyState=loading)

Comment 7

[Andrei Eftimie]

Attachment: skip.patch

I'd like to disable this test for now. This is really unreliable and is constantly failing.

This applies to default, mozilla-aurora and mozilla-beta

Comment 8

[Andreea Matei [:AndreeaMatei]]

Comment on attachment 8511083 [details] [diff] [review]
skip.patch

Review of attachment 8511083 [details] [diff] [review]:
-----------------------------------------------------------------

Looks good.

Comment 9

[Andrei Eftimie]

Disabled:
https://hg.mozilla.org/qa/mozmill-tests/rev/73fbffab24c8 (default) 
https://hg.mozilla.org/qa/mozmill-tests/rev/18126d037e8b (mozilla-aurora)
https://hg.mozilla.org/qa/mozmill-tests/rev/2b3167614438 (mozilla-beta)

We don't expect another 33 build for a while. If we don't have any updates here until then, we might also disable it for the next one.

Comment 10

[Cosmin Malutan, [:cosmin-malutan]]

bug 1071515 comment 18, let's get this skip backported on release too!

Comment 11

[Andrei Eftimie]

Ugh, I was optimistic.

Had a new release build, failed and crashed a lot, disabled as well:
https://hg.mozilla.org/qa/mozmill-tests/rev/5da4a715fadb (mozilla-release)

Comment 12

[Andrei Eftimie]

Failed a lot on ESR31 in the last couple of days.
Transplanted the skip:
https://hg.mozilla.org/qa/mozmill-tests/rev/d9a27f38e87d (mozilla-esr31)

Comment 13

[Mihaela Velimiroviciu (:mihaelav)]

I couldn't reproduce this locally (Win 8.1 64bit VM) nor on staging (Win 8.1 x86).
http://mozmill-crowd.blargon7.com/#/remote/reports?app=All&branch=38&platform=Win&from=2015-01-29&to=2015-01-30

Comment 14

[Mihaela Velimiroviciu (:mihaelav)]

I think we can unskip this now.

Comment 15

[Andreea Matei [:AndreeaMatei]]

Lets see:
https://hg.mozilla.org/qa/mozmill-tests/rev/12f048f0c643 (default)

Comment 16

[Mihaela Velimiroviciu (:mihaelav)]

The test hasn't failed since it was un-skipped.
Maybe we should enable it on the other branches, as well.

Comment 17

[Ed Morley [:emorley]]

Removing keyword, since it's intended for test failures that are seen on Treeherder (and otherwise you'll end up with bugs being marked as worksforme if no occurrences are seen on Treeherder).

Let me know if you want a new keyword created for intermittent mozmill failures :-)

Comment 18

[Robert Kaiser]

(In reply to Ed Morley [:emorley] from comment #17)
> Let me know if you want a new keyword created for intermittent mozmill
> failures :-)

Mozmill tests are dead, and their replacement Marionette (Firefox UI) tests will report to treeherder (soon).

Comment 19

[Ed Morley [:emorley]]

Ah, thank you

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Mozmill tests have been superseded by Marionette tests.