1108481 - Test failure 'Autocomplete popup has been opened - expected 'true'' in /testAwesomeBar/testCheckItemHighlight.js

Status: RESOLVED INVALID

(Mozilla QA Graveyard :: Mozmill Tests, defect, P2)

Description

[Cosmin Malutan, [:cosmin-malutan]]

Module:    /testAwesomeBar/testCheckItemHighlight.js
Test:      testCheckItemHighlight    
Failure:   Test failure 'Autocomplete popup has been opened - expected 'true''
Branches:  default
Platforms: OSX

Failed twice on osx with Firefox default.
http://mozmill-daily.blargon7.com/#/functional/failure?app=Firefox&branch=All&platform=All&from=2014-12-01&to=&test=%2FtestAwesomeBar%2FtestCheckItemHighlight.js&func=testCheckItemHighlight

Comment 1

[Andreea Matei [:AndreeaMatei]]

Only OSX I see affected here, mostly 10.8, there are only one report for 10.7 and one for 10.9.

Comment 2

[Cosmin Malutan, [:cosmin-malutan]]

Failed for 19 times with the latest beta spin on OSX, it should be skipped.

Comment 3

[Cosmin Malutan, [:cosmin-malutan]]

Attachment: skip-patch beta

Here is the skip patch for beta.

Comment 4

[Andreea Matei [:AndreeaMatei]]

Comment on attachment 8542543 [details] [diff] [review]
skip-patch beta

Review of attachment 8542543 [details] [diff] [review]:
-----------------------------------------------------------------

http://hg.mozilla.org/qa/mozmill-tests/rev/f422ed3c719f (beta)

Comment 5

[Daniela Domnici]

I`ve tried to reproduce it using OS X 10.8.5 staging machine on three different locals. it didn`t fail at all.Here are the results:
http://mozmill-crowd.blargon7.com/#/functional/reports?app=All&branch=35&platform=Mac&from=2015-01-08&to=2015-01-08

Comment 6

[Daniela Domnici]

I`ve tried to reproduce it using OS X 10.8.5-1 production machine. I`ve done about 35 testruns for beta branch using gu-IN local.

Here are the results: http://mozmill-crowd.blargon7.com/#/functional/reports?app=All&branch=35&platform=Mac&from=2015-01-09&to=2015-01-12

Comment 7

[Andreea Matei [:AndreeaMatei]]

This was unskipped with the merge last night, didn't fail so far, lets keep an eye today.

Comment 8

[Mihaela Velimiroviciu (:mihaelav)]

Some new failures in beta:
mozmill-release.blargon7.com/#/functional/failure?app=Firefox&branch=36&platform=All&from=2015-01-08&to=2015-01-15&test=%2FtestAwesomeBar%2FtestCheckItemHighlight.js&func=testCheckItemHighlight

Comment 9

[Daniela Domnici]

With the new build of beta this test not fail at all.Here are the results:
http://mozmill-release.blargon7.com/#/remote/reports?app=All&branch=36&platform=All&from=2015-01-18&to=2015-01-21 -> http://mozmill-release.blargon7.com/#/functional/failure?app=Firefox&branch=36&platform=All&from=2015-01-18&to=2015-01-21&test=%2FtestAwesomeBar%2FtestCheckItemHighlight.js&func=testCheckItemHighlight .

Comment 10

[Andreea Matei [:AndreeaMatei]]

I see on nightly and aurora is green too since December, so we can close here.

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is still failing for us in daily and release tests. Given that this is a test we will convert to Marionette soon, I'm going to disable it across all branches.

Comment 12

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: full skip patch

Comment 13

[Henrik Skupin [:whimboo][⌚️UTC+2]]

For safety I disabled the test everywhere:

http://hg.mozilla.org/qa/mozmill-tests/rev/d53c92d64d56 (default)
http://hg.mozilla.org/qa/mozmill-tests/rev/96885ae75494 (aurora)
http://hg.mozilla.org/qa/mozmill-tests/rev/3c120c7c4a96 (beta)
http://hg.mozilla.org/qa/mozmill-tests/rev/3a56730075e3 (release)
http://hg.mozilla.org/qa/mozmill-tests/rev/14e66857901d (esr31)

Comment 14

[Ed Morley [:emorley]]

Removing keyword, since it's intended for test failures that are seen on Treeherder (and otherwise you'll end up with bugs being marked as worksforme if no occurrences are seen on Treeherder).

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Mozmill tests have been superseded by Marionette tests.