Test: testSearchAddons Failure: Addons have been found - got 'false' Branches: 23 Platforms: OSX We have 1 failure on Beta (23), en-US on OSX: http://mozmill-release.blargon7.com/#/remote/report/b3aefd29a5c41bda1cc43616d3aecacb
This may have been a temporary issue with AMO. It hasn't recurred in over a week, so I'm going to close as WORKSFORME. Please reopen if this issue comes back.
We're still seeing an occasional failure, like: http://mozmill-daily.blargon7.com/#/remote/report/837c1e0f361ac93453ee69721976b55a Might very well be connectivity problems with AMO. Since this test is a remote one now, we can't track it in the dashboard :( I'll reopen it right now, lets see when its failing again.
It failed again on Mac 10.7.5 with Release de: http://mozmill-release.blargon7.com/#/remote/report/0bbed480c5898d9d02bca5d17985628e
It failed on: mac 10.7, 10.8 and 10.9 with esr_24.3 and 26.0(release) I couldn't reproduce it, being a remote test it might been an issue with AMO.
Failed again with Aurora en-US on Windows xp x86 (mm-win-xp-32-3) http://mozmill-daily.blargon7.com/#/remote/report/16dc29d7a411d565992bbd7dc82db56b
http://mozmill-daily.blargon7.com/#/remote/failure?app=All&branch=All&platform=All&from=2014-05-05&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons Failed several times on Aurora 31 yesterday. All during a 1 hour period. All on Ubuntu. Not reproducible.
This is failing again for Beta and Aurora so far, several locales. Might be a network issue, looking to reproduce now: http://mozmill-daily.blargon7.com/#/remote/failure?app=Firefox&branch=33.0&platform=All&from=2014-08-19&to=&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons http://mozmill-release.blargon7.com/#/remote/failure?app=Firefox&branch=32.0&platform=All&from=2014-08-19&to=&test=%2FtestAddons%2FtestSearchAddons.js&func=testSearchAddons
I can reproduce this locally by running the mozmill test with Beta and Aurora. After searching for rss, no addons are retrieved. Will look further.
https://addons-dev.allizom.org/ is down. I'll add a skip patch just in case it takes longer to fix.
Created attachment 8475116 [details] [diff] [review] skip.patch Disabling patch.
Comment on attachment 8475116 [details] [diff] [review] skip.patch Review of attachment 8475116 [details] [diff] [review]: ----------------------------------------------------------------- Disabled: https://hg.mozilla.org/qa/mozmill-tests/rev/667ce2a60961 (default) https://hg.mozilla.org/qa/mozmill-tests/rev/10d6029a1624 (mozilla-aurora)
Transplanted: https://hg.mozilla.org/qa/mozmill-tests/rev/cd5eb193a659 (mozilla-beta) https://hg.mozilla.org/qa/mozmill-tests/rev/c89e3dd97427 (mozilla-release) https://hg.mozilla.org/qa/mozmill-tests/rev/75f04cf08dc1 (mozilla-31)
All this is caused by an outage of the addons-dev server as tracked in bug 1055509
The underlying issue has been fixed. Backed out skip: https://hg.mozilla.org/qa/mozmill-tests/rev/d4a44193b095 (default) https://hg.mozilla.org/qa/mozmill-tests/rev/ef062c97da97 (mozilla-aurora) https://hg.mozilla.org/qa/mozmill-tests/rev/295fa1fe73a2 (mozilla-beta) https://hg.mozilla.org/qa/mozmill-tests/rev/7e886131f900 (mozilla-release) https://hg.mozilla.org/qa/mozmill-tests/rev/a587070dd60f (mozilla-esr31)
Problems like those concern me a lot! So I filed bug 1058445 to get rid of the dev server but use the production or staging one.