821716 - Test failure "There is one less cookie than before - '0' should equal '-1'" in testPreferences/testRemoveCookie.js

Status: RESOLVED INVALID

(Mozilla QA Graveyard :: Mozmill Tests, defect, P4)

Description

[Andreea Matei [:AndreeaMatei]]

This started to fail today, on Nightly en-US and fr locales, with Linux.

I believe there was a change in the browser so we no longer need to substract 1:
http://hg.mozilla.org/qa/mozmill-tests/file/570edabfa273/tests/functional/testPreferences/testRemoveCookie.js#l91

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Didn't happen again. Closing as WFM.

Comment 2

[Daniela Petrovici]

Happened for ESR17 on MAC OS 10.7.5:
http://mozmill-ci.blargon7.com/#/functional/report/14f8bc4e22e61353662cded4c2c548c0

Comment 3

[Andrei Eftimie]

In the last 6 months we've seen this fail:

In the daily testruns with 2 builds:
http://mozmill-daily.blargon7.com/#/functional/failure?branch=All&platform=All&from=2012-08-01&test=%2FtestPreferences%2FtestRemoveCookie.js&func=testRemoveCookie.js%3A%3AtestRemoveCookie

26.0a1 (20130822030204) failed on the 22nd August 2013 on Ubuntu 12.04 - (all locales, total 8 failures)
26.0a2 (20131014004003) failed on the 14th October 2013 on Windows 8 - (en-US, 2 failures)

And on the release testruns only 1 build failed:
http://mozmill-release.blargon7.com/#/functional/failure?branch=All&platform=All&from=2012-08-01&test=%2FtestPreferences%2FtestRemoveCookie.js&func=testRemoveCookie.js%3A%3AtestRemoveCookie

26.0 (20131202205747) on the 3rd December with Ubunutu 12.04 - (all locales)

If you check any report from the last 6 months, when we saw this failure, something else went wrong, we have between 10-25 other failures in the same testrun.

I'll mark this as WFM, since the last valid reported failure is about 7 months old.

Comment 4

[Andrei Eftimie]

Hesitant to reopen this bug.

Failed twice in the past couple months.

Once on ESR24 (which is now EOL): http://mozmill-daily.blargon7.com/#/functional/report/c1ae8473ee5b384b83bbfde3310bb351
And once on ESR31: http://mozmill-daily.blargon7.com/#/functional/report/4b004f9a9a3a5bc3aa0f3a07c1040b37

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Mozmill tests have been superseded by Marionette tests.