899923 - Test failure "Addons have been found - got 'false'" in /testAddons/testSearchAddons.js

Status: RESOLVED FIXED

(Mozilla QA Graveyard :: Mozmill Tests, defect, P1)

Description

[Andrei Eftimie]

Test:      testSearchAddons    
Failure:   Addons have been found - got 'false'
Branches:  23
Platforms: OSX

We have 1 failure on Beta (23), en-US on OSX:
http://mozmill-release.blargon7.com/#/remote/report/b3aefd29a5c41bda1cc43616d3aecacb

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

This may have been a temporary issue with AMO. It hasn't recurred in over a week, so I'm going to close as WORKSFORME. Please reopen if this issue comes back.

Comment 2

[Andrei Eftimie]

We're still seeing an occasional failure, like:
http://mozmill-daily.blargon7.com/#/remote/report/837c1e0f361ac93453ee69721976b55a

Might very well be connectivity problems with AMO.

Since this test is a remote one now, we can't track it in the dashboard :(
I'll reopen it right now, lets see when its failing again.

Comment 3

[Cosmin Malutan, [:cosmin-malutan]]

It failed again on Mac 10.7.5 with Release de:
http://mozmill-release.blargon7.com/#/remote/report/0bbed480c5898d9d02bca5d17985628e

Comment 4

[Cosmin Malutan, [:cosmin-malutan]]

It failed on:
mac 10.7, 10.8 and 10.9 with esr_24.3 and 26.0(release)
I couldn't reproduce it, being a remote test it might been an issue with AMO.

Comment 5

[Cosmin Malutan, [:cosmin-malutan]]

Failed again with Aurora en-US on Windows xp x86 (mm-win-xp-32-3)
http://mozmill-daily.blargon7.com/#/remote/report/16dc29d7a411d565992bbd7dc82db56b

Comment 6

[Andrei Eftimie]

http://mozmill-daily.blargon7.com/#/remote/failure?app=All&branch=All&platform=All&from=2014-05-05&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons

Failed several times on Aurora 31 yesterday. All during a 1 hour period. All on Ubuntu.
Not reproducible.

Comment 7

[Andreea Matei [:AndreeaMatei]]

This is failing again for Beta and Aurora so far, several locales. Might be a network issue, looking to reproduce now:
http://mozmill-daily.blargon7.com/#/remote/failure?app=Firefox&branch=33.0&platform=All&from=2014-08-19&to=&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons

http://mozmill-release.blargon7.com/#/remote/failure?app=Firefox&branch=32.0&platform=All&from=2014-08-19&to=&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons

Comment 8

[Andreea Matei [:AndreeaMatei]]

I can reproduce this locally by running the mozmill test with Beta and Aurora. After searching for rss, no addons are retrieved. Will look further.

Comment 9

[Andreea Matei [:AndreeaMatei]]

https://addons-dev.allizom.org/ is down. I'll add a skip patch just in case it takes longer to fix.

Comment 10

[Andreea Matei [:AndreeaMatei]]

Attachment: skip.patch

Disabling patch.

Comment 11

[Andrei Eftimie]

Comment on attachment 8475116 [details] [diff] [review]
skip.patch

Review of attachment 8475116 [details] [diff] [review]:
-----------------------------------------------------------------

Disabled:
https://hg.mozilla.org/qa/mozmill-tests/rev/667ce2a60961 (default)
https://hg.mozilla.org/qa/mozmill-tests/rev/10d6029a1624 (mozilla-aurora)

Comment 12

[Andrei Eftimie]

Transplanted:
https://hg.mozilla.org/qa/mozmill-tests/rev/cd5eb193a659 (mozilla-beta)
https://hg.mozilla.org/qa/mozmill-tests/rev/c89e3dd97427 (mozilla-release)
https://hg.mozilla.org/qa/mozmill-tests/rev/75f04cf08dc1 (mozilla-31)

Comment 13

[Andrei Eftimie]

All this is caused by an outage of the addons-dev server as tracked in bug 1055509

Comment 14

[Andrei Eftimie]

The underlying issue has been fixed.

Backed out skip:
https://hg.mozilla.org/qa/mozmill-tests/rev/d4a44193b095 (default)
https://hg.mozilla.org/qa/mozmill-tests/rev/ef062c97da97 (mozilla-aurora)
https://hg.mozilla.org/qa/mozmill-tests/rev/295fa1fe73a2 (mozilla-beta)
https://hg.mozilla.org/qa/mozmill-tests/rev/7e886131f900 (mozilla-release)
https://hg.mozilla.org/qa/mozmill-tests/rev/a587070dd60f (mozilla-esr31)

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Problems like those concern me a lot! So I filed bug 1058445 to get rid of the dev server but use the production or staging one.