801662 - "Nightly Builds" entries missing from UI since Oct 13th

Status: VERIFIED FIXED

(Socorro :: General, task)

Description

[Scoobidiver (away)]

Crashes per build have been no longer available since Oct 13th from the UI.

See https://crash-stats.mozilla.com/products/Firefox/builds and https://crash-stats.mozilla.com/products/FennecAndroid/builds

You can still access them if you know the buildID, for instance https://crash-stats.mozilla.com/query/query?product=Firefox&version=Firefox:19.0a1&build_id=20121015030612&do_query=1

Comment 1

[Laura Thomson :laura]

Feels like a cron failure.

Comment 2

[Robert Helmer [:rhelmer]]

(In reply to Laura Thomson :laura from comment #1)
> Feels like a cron failure.

It is indeed (see bug 801724), looks like cronjob hanging. 

We'll need to backfill when this is done.

Comment 3

[Scoobidiver (away)]

It happens again with the builds from October 25.

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

FWIW, caught by our automation, and I asked about it in the channel, but didn't raise it properly; will do from now on:

http://qa-selenium.mv.mozilla.com:8080/view/Socorro/job/socorro.prod/4782/

Comment 5

[Matt Brandt [:mbrandt]]

I'm not sure if a cron kicked (manually or otherwise) off but our automation is now passing as well as  https://crash-stats.mozilla.com/products/Firefox/builds now showing results.

Comment 6

[Matt Brandt [:mbrandt]]

Attachment: qa - Firefox builds are present

Comment 7

[Scoobidiver (away)]

Today's builds usually show up as soon as they are built but I don't see any builds from November 2nd.

Comment 8

[Matt Brandt [:mbrandt]]

(In reply to Scoobidiver from comment #7)
> Today's builds usually show up as soon as they are built but I don't see any
> builds from November 2nd.

Looks like I was a bit over-excited to close the bug -- Scoobidiver you're right on with your analysis. The cron is still hanging (bug 808055).

Comment 9

[Matt Brandt [:mbrandt]]

Attachment: qa - waiting for backfill

The cron has been unhung -- selenamarie noted in #breakpad that backfill is currently running and should give us the missing datas soon.

Comment 10

[Selena Deckelmann :selenamarie :selena]

Should be good now.

Comment 11

[Matt Brandt [:mbrandt]]

Attachment: qa - reopened

Reopening: we still appear to be missing builds.

Comment 12

[Scoobidiver (away)]

(In reply to Matt Brandt [:mbrandt] from comment #11)
> Reopening: we still appear to be missing builds.
I filed bug 808579 for that.

Comment 13

[Matt Brandt [:mbrandt]]

Attachment: qa - verified

Scoobidiver thanks again for catching this -- bumping to verified -- see screenshot