628685 - have a single downloader script for mozilla products

Status: RESOLVED WONTFIX

(Testing :: General, defect)

Description

[Jeff Hammel]

We have a fairly standardized set of naming conventions for various
files at amongst other places
http://stage.mozilla.org/pub/mozilla.org/firefox/

To take but one example:

http://stage.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-central-linux-debug/1295885346/firefox-4.0b10pre.en-US.linux-i686.tar.bz2

This may be written as

$(BASE_URL)/$(BRANCH)-$(PLATFORM)-debug/$(TIMESTAMP)/firefox-$(VERSION).$(LOCALE).$(PLATFORM)-i686.tar.bz2

Various scripts have been written to programmatically download the
binaries, the tests, the logs, etc:

 - http://hg.mozilla.org/automation/getlatest-tinderbox
 - https://bugzilla.mozilla.org/show_bug.cgi?id=528064
 - https://github.com/harthur/mozregression/blob/master/mozregression/runnightly.py
 - probably many many more

These tools should be consolidated into a single tool that both
illustrates the conventions used as well as allows sensible
programmatically driven retrieval of these files so that a single
piece of software is maintained.  This software should also be
publicized to the point that people know that it exists and no one
else also reinvents this wheel.

Comment 1

[Jeff Hammel]

Filing under Testing - General, though maybe it belongs elsewhere.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

It's probably not that easy at this stage. Some tools are still in developement, especially anything related to pulse. But I agree, at some point it would be beneficial to have a single Python module which incorporates the download of all different types.

Let me see what we need: 
* Release builds
* Release candidate builds
* Nightly builds
* Tinderbox builds
* Project branch builds
* Pulse triggered builds

This script should also support Firefox and Thunderbird

Anything else I forgot?

Comment 3

[Jeff Hammel]

A few more scripts from the old bug 582980:

- http://hg.mozilla.org/users/tmielczarek_mozilla.com/nightly-db/
- http://test.bclary.com/bin/download.sh
- http://code.google.com/p/mozregression/source/browse/trunk/runnightly.py

Comment 5

[Jonathan Griffin (:jgriffin)]

Note that anything that depends on a buildbot build from the FTP site will have to be updated at some point as the url's are changing, see bug 449607.  Another reason why a common piece of code to handle this would be nice.

Comment 6

[Geoff Brown [:gbrown]]

Mass closing bugs with no activity in 2+ years. If this bug is important to you, please re-open.