735363 - Bouncer doesn't report uptake for Firefox 11.0

Status: RESOLVED FIXED

(Release Engineering :: Release Requests, defect)

Description

[Rail Aliiev [:rail]]

http://people.mozilla.org/~raliiev/sattap/21e3cf0f.png

I checked it a couple of hours ago and it was reporting uptake around 3 for all products.

Comment 1

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

...
11:52:53 <@akeybl> rail: ashughes: I'm getting "update failed" in the about dialog for 10.0.2->11 manual
11:53:20  * rail suspects bouncer
11:53:48 < joduinn> rail: on desktop OSX, doing manual check in 10.0.2, I also get "update failed" instead of 11.0
11:54:03 < joduinn> ...for manual attempt to update. just like akeybl 
...
11:54:16 < rail> joduinn: filing a bug
...
11:58:11 < rail> joduinn, akeybl I disabled all updates for now
...


Obviously, this blocks this morning's FF11.0.0 release.

Comment 2

[Rail Aliiev [:rail]]

QA signed off the snippets which are be served by bouncer ~15hrs ago.

Comment 3

[Rail Aliiev [:rail]]

3 minutes ago:
http://people.mozilla.org/~raliiev/sattap/205e2e5e.png

now:
http://people.mozilla.org/~raliiev/sattap/e3e15941.png

Comment 4

[Rail Aliiev [:rail]]

This applicable to all Firefox 11.0 download links and update snippets (which are served by bouncer).

Comment 5

[Dave Miller [:justdave]]

The Firefox 11 files are not listed in the rsync exclude files to be synced to the mirrors.

Comment 6

[Chris AtLee [:catlee]]

changes to our process have been documented here:
https://wiki.mozilla.org/index.php?title=Releases%2FBuildNotesTemplate&action=historysubmit&diff=407179&oldid=404283

Comment 7

[Chris AtLee [:catlee]]

There were two problems here:

Firefox 11 was excluded from the releases module to delete build1 bits from the mirrors. This is not normally part of our process, so cleaning this up was missed.

Firefox 11 was also not added to the 'current' module.

The combination of the two meant that no external mirrors could get the firefox 11 files.

Comment 8

[Rail Aliiev [:rail]]

Additionally, sentry was trying to check the internal mirrors and was failing due to high load of the mirrors. As a result it was removing the internal mirrors from uptake.