679589 - kill staging/preproduction tinderbox mail

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Aki Sasaki (not active)]

Attachment: nick's pastebin -- including count from bad dir

This should help a bit. See bug 679448 as well as the attachment.

We shunt non-existent tree mail to a bad directory, but that's still something the server has to deal with.

Comment 1

[Aki Sasaki (not active)]

Let's kill:

* MobileTest (n900 and tegra staging)
* MozillaTest ?
* MozillaStaging*
* Releng-Preproduction-* (and Releng-Preproduction itself?)

Comment 2

[Aki Sasaki (not active)]

Attachment: corrected pastebin

Corrected pastebin.

However, the bad directory means we're sending a ton of mail for tinderbox trees that don't even exist. Cutting back on that can only help. Not sure how much.

Comment 3

[Aki Sasaki (not active)]

Hm, I was going to try to add a flag that defaulted to 'off' in generateBranchObjects and generateTalosBranchObjects, but there's no separation in the master.cfg's between staging and production, so that's not great.

I may have to bite the bullet and just add disable_tinderbox_mail = True to all branches in staging_config.py and preproduction_config.py. Also in mozilla-tests.

Also, I'm tempted to kill all n900 tinderbox email.  Certainly turning off Tracemonkey for the n900s is a good thing.

Comment 4

[Aki Sasaki (not active)]

Hm, I bet removing the MobileFtpPoller idleTimeout will help.
As well as turning off old n900 branches.

http://hg.mozilla.org/build/buildbot-configs/file/9a3ddeda3450/mobile/master.cfg#l75

Comment 5

[Aki Sasaki (not active)]

Attachment: turn off old n900 branches

* turn off old n900 branches
* turn off idle timeout in ftp poller
* I shut down staging-mobile-master:8010; we can turn it back on if/when we need to test something.

Comment 6

[Aki Sasaki (not active)]

Attachment: tinderbox mail throttle for projects, releases (buildbotcustom)

Comment 7

[Aki Sasaki (not active)]

Attachment: tinderbox mail throttle for staging (buildbot-configs)

Comment 8

[Aki Sasaki (not active)]

Attachment: diff -U0 clean.dump patched.dump > ~/Desktop/dump.diff

1023$ grep tree ~/Desktop/dump.diff| sort | uniq
- 'tree': 'MobileTest',
- 'tree': 'MozillaStaging',
- 'tree': 'MozillaTest',
- 'tree': 'MozillaTest-Release',
- 'tree': 'Releng-Preproduction',
- 'tree': <buildbot.process.properties.WithProperties>,

Comment 9

[Aki Sasaki (not active)]

Comment on attachment 553711 [details] [diff] [review]
tinderbox mail throttle for staging (buildbot-configs)

http://hg.mozilla.org/build/buildbot-configs/rev/2ff00fecb1f2

Comment 10

[Aki Sasaki (not active)]

Comment on attachment 553706 [details] [diff] [review]
tinderbox mail throttle for projects, releases (buildbotcustom)

http://hg.mozilla.org/build/buildbotcustom/rev/8a2a53657870

Comment 11

[Aki Sasaki (not active)]

Comment on attachment 553695 [details] [diff] [review]
turn off old n900 branches

http://hg.mozilla.org/build/buildbot-configs/rev/fe9c97c28485

Comment 12

[Aki Sasaki (not active)]

pmm reconfiged, but I have the sneaking suspicion that the idletimeout in MobileFtpPoller will require a restart.

Still, killing 3 old branches is a start.