534953 - maemo l10n repacks on pm02 haven't run since dec 8

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Aki Sasaki (not active)]

I'm forcing one manually.
Guessing something's wrong with the trigger?

Comment 1

[Armen [:armenzg]]

I thought that this could have been a fall out from bug 527989 but it was landed on the 9th and there was an en-US nightly build which should have triggered it.

The build #139 (the 8th) has this step:
trigger  [triggered Maemo mozilla-1.9.2 l10n]
The build #140 (the 9th) does not have that step.

Comment 3

[Chris Cooper [:coop] (he/him)]

Hard to tell without logs (they rotated a few days ago), but given that this happened *before* Armen landed his repack-on-change code (Dec 9), this has the same symptoms of previous events where we lost a scheduler during a reconfig due to a hung slave. We had a reconfig of pm02 at 10:30AM PST on Dec 8.

I'm going to schedule a full restart of pm02 for either Sat. AM or early next week to see whether we can get the schedulers back.

Comment 4

[Chris Cooper [:coop] (he/him)]

Downtime scheduled for Friday, December 18, 2009 at 9:00pm PST. 

If we can't make that timeslot, we'll try again on Saturday, December 19, 2009 at 9:00pm PST.

Comment 5

[Chris Cooper [:coop] (he/him)]

(In reply to comment #4)
> Downtime scheduled for Friday, December 18, 2009 at 9:00pm PST. 

Master was restarted as planned. I'll check tomorrow to see whether nightly repacks were triggered.

Comment 6

[Chris Cooper [:coop] (he/him)]

The restart didn't actually help.

My working theory is that we lost the schedulers during the reconfig on Dec 8th, and then Armen's repack-on-change landing on the 9th broke things in another way.

Will investigate more on Monday.

Comment 7

[Chris Cooper [:coop] (he/him)]

Attachment: Count steps after adding trigger step

Comment 8

[Chris Cooper [:coop] (he/him)]

Comment on attachment 418668 [details] [diff] [review]
Count steps after adding trigger step

http://hg.mozilla.org/build/buildbotcustom/rev/685fd4d1d940

Comment 9

[Chris Cooper [:coop] (he/him)]

pm02 has been reconfig-ed with this change.