601971 - Nightly builds option produces no data

Status: VERIFIED FIXED

(Socorro :: General, task)

Description

[Stephen Donner [:stephend] Not actively reading bugmail]

The Nightly Builds option (Firefox/Thunderbird, etc.) currently produces no data:

http://crash-stats.stage.mozilla.com/products/Firefox/builds
http://crash-stats.stage.mozilla.com/products/Thunderbird/builds

Comment 1

[Ryan Snyder [:ryansnyder] [:rsnyder] [:rysny]]

Thanks Stephen.

It looks like we didn't have the most recent product versions added via the admin panel on stage.  (I haven't looked into why we lost that data - those versions used to be enabled on stage.)  Assuming the cron is setup properly, we'll find Firefox builds in the morning.

Thunderbird builds won't appear tomorrow.  They were never enabled in 1.7.  We'll need to test Thunderbird and other Products once we move to 1.8.

Comment 2

[Ryan Snyder [:ryansnyder] [:rsnyder] [:rysny]]

Builds data not appearing on stage this morning.  Created bug 602246 to troubleshoot.

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to comment #2)
> Builds data not appearing on stage this morning.  Created bug 602246 to
> troubleshoot.

Thanks, Ryan; quick question: when writing the manual test for this, how do I best verify that http://crash-stats.stage.mozilla.com/products/Firefox/builds contains the right data?

Comment 4

[Ryan Snyder [:ryansnyder] [:rsnyder] [:rysny]]

Below is a long explanation of what the script accomplishes.  For testing, the main thing that I look for is to verify that the builds page contains links from the previous night.

==

First, we're checking for data in a couple places in the nightly builds FTP site:
http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/
http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.2/
http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-1.9.1/

The script is looking for the .txt files in these directories, e.g.:
firefox-4.0b8pre.en-US.linux-x86_64.txt

The script looks for all of the most recent versions containing "pre" in the version name.  In 1.7 it only looks for Firefox versions; in 1.8 it will look for all product versions (Camino does not work).

It pulls the build ids for the following platforms:
'linux-i686,linux-x86_64,mac,win32'

Then it creates links on the builds page, which link to a query to show the crashing signatures related to that build on the advanced search page.
http://crash-stats.mozilla.com/products/Firefox/builds

For a version to return search results, it will have to have been added via the admin panel and appear in the navigation bar in the site.

Comment 5

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

(In reply to comment #4)
> The script is looking for the .txt files in these directories, e.g.:
> It pulls the build ids for the following platforms:
> 'linux-i686,linux-x86_64,mac,win32'

Ryan, fyi, you'll need to add 'mac64' to the platforms to be able to find Mac Firefoxen on mozilla-central and friends (*monkey, mozilla-2.0) going forward; this changed last week in bug 571367.

Comment 6

[Ryan Snyder [:ryansnyder] [:rsnyder] [:rysny]]

Thanks Smokey!  I've filed bug 602898 to update the builds config file in production.

Also committing config change to the Socorro 1.7.4 branch and Socorro trunk:
Sending        buildsconfig.py.dist
Transmitting file data .
Committed revision 2571.
Committed revision 2572.

No other config changes will be necessary in the 1.7.5 or 1.8 releases.

Comment 7

[Robert Kaiser]

Does comment #6 means this is fixed? If so, it probably should be marked as such :)

Comment 8

[Ryan Snyder [:ryansnyder] [:rsnyder] [:rysny]]

This particular issue was resolved.  The other outstanding issues were resolved in Bug 630559.

Comment 9

[Stephen Donner [:stephend] Not actively reading bugmail]

Verified FIXED:

Staging:
https://crash-stats-dev.allizom.org/products/Firefox/builds
https://crash-stats-dev.allizom.org/products/Thunderbird/builds

Production:
https://crash-stats.mozilla.com/products/Firefox/builds
https://crash-stats.mozilla.com/products/Thunderbird/builds

I ran Xenu (a link checker: http://home.snafu.de/tilman/xenulink.html) on all the pages.