575739 - run addon tests once weekly

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[alice nodelman [:alice] [:anode]]

I've installed the triggeraddons.sh script in /builds/buildbot/addons on both talos-master02 and test-master01.  This script should be run once weekly to generate performance results for addons.

I've held back from setting up a crontab as we may want to simply kick this off for a couple of weeks so that we can observe the results and be sure that everything is working as desired.

Comment 1

[alice nodelman [:alice] [:anode]]

Doing an initial manual test of the script, testing just the top 5 addons.

Comment 2

[Aki Sasaki (not active)]

0 6 * * 6	(cd /builds/buildbot/addons; ./triggeraddons.sh addons.txt 2>&1 > trigger.log)

Should do it, I think.

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Changed this to run
 (source /home/cltbld/.bash_profile && cd /builds/buildbot/addons && ./triggeraddons.sh addons.txt 2>&1 > trigger.log)
so that buildbot is on the path, on talos-master02 and test-master01.

Comment 4

[alice nodelman [:alice] [:anode]]

First set of results here:
http://tinderbox.mozilla.org/showbuilds.cgi?tree=Firefox3.6&maxdate=1279429851&hours=24&legend=0&norules=1

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

I think we need to rework this after the move to buildbot 0.8.0. There were no addons tests run this weekend.

Comment 6

[alice nodelman [:alice] [:anode]]

Did the sendchange format change?

Comment 7

[alice nodelman [:alice] [:anode]]

I'm suspicious that the switch over to the scheduler master broke this.  I'm seeing logs claiming that sendchanges have been successfully sent.

Here's an example of one of the lines in question:

buildbot sendchange --username addontester --master=localhost:$PORT --branch=addontester-macosx --property addonName:$NAME --property addonUrl:$URL $BUILDURL$MACOSX

Does the scheduler understand '--property'?

Comment 8

[alice nodelman [:alice] [:anode]]

catlee has suggested adding -talos to the branchnames - I'll give that a try this afternoon and see if this can be resurrected.

Comment 9

[alice nodelman [:alice] [:anode]]

I fixed up the branch names and sent a single addon through testing to confirm that things are okay.

Everything back to working again.

Woot.

Comment 10

[alice nodelman [:alice] [:anode]]

As a note, the script is now only run on talos-master02.  No longer need to have it run on test-master01/02 as all sendchanges are sent to the central repository and then distributed.