990775 - Fully decommission no longer used buildbot masters

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Justin Wood (:Callek)]

This includes decom from slavealloc, getting IT to kill netflows removal from nagios and removal from signing server allows (if any).

We may have a few other outliers to check of course, and this probably will be best done with coord with IT and/or sub-bugs for the work item.

Full list from: https://bugzilla.mozilla.org/show_bug.cgi?id=976281#c10

* buildbot-master69
* buildbot-master80
* buildbot-master90
* buildbot-master92
* buildbot-master93
* buildbot-master95
* buildbot-master96
* buildbot-master97
* buildbot-master98

Might need a cross check.

Comment 1

[Massimo Gervasini [:massimo]]

buildbot-master69 is in production (windows tests master), not removing it.

Adding the list of masters that have been replaced in bug 966007:

* buildbot-master55.srv.releng.use1.mozilla.com 10.134.49.93
* buildbot-master56.srv.releng.usw2.mozilla.com 10.132.50.142
* buildbot-master57.srv.releng.use1.mozilla.com 10.134.48.228
* buildbot-master58.srv.releng.usw2.mozilla.com 10.132.49.125
* buildbot-master59.srv.releng.use1.mozilla.com 10.134.49.223
* buildbot-master60.srv.releng.usw2.mozilla.com 10.132.50.56
* buildbot-master61.srv.releng.use1.mozilla.com 10.134.49.62
* buildbot-master62.srv.releng.use1.mozilla.com 10.134.48.236
* buildbot-master63.srv.releng.use1.mozilla.com 10.134.48.196
* buildbot-master64.srv.releng.usw2.mozilla.com 10.132.50.44
* buildbot-master65.srv.releng.usw2.mozilla.com 10.132.49.112
* buildbot-master66.srv.releng.usw2.mozilla.com 10.132.50.247
* buildbot-master80.srv.releng.usw2.mozilla.com 10.132.49.150
* buildbot-master90.srv.releng.use1.mozilla.com 10.134.49.133
* buildbot-master92.srv.releng.use1.mozilla.com 10.134.49.214
* buildbot-master93.srv.releng.usw2.mozilla.com 10.132.50.156
* buildbot-master95.srv.releng.usw2.mozilla.com 10.132.49.197
* buildbot-master96.srv.releng.use1.mozilla.com 10.134.48.53
* buildbot-master97.srv.releng.usw2.mozilla.com 10.132.50.51
* buildbot-master98.srv.releng.use1.mozilla.com 10.134.48.51
 
Notes:
starting the decommission process, at least for the buildbot master netflows, for bm65 and bm66 too even if they are still running some other services (gaia/b2g bumper and slaverebooter)

Comment 2

[Massimo Gervasini [:massimo]]

Attachment: [puppet] Bug 990775 - remove bm66 IP from signing_new_token_allowed_ips.patch

Removed bm66 IP address signing_new_token_allowed_ips

Comment 3

[Massimo Gervasini [:massimo]]

> Adding the list of masters that have been replaced in bug 966007:
err bug 966070

Comment 4

[Massimo Gervasini [:massimo]]

Status update:

all the nagios notifications and netflows have been disabled for machines in comment 1, except for:

* buildbot-master65.srv.releng.usw2.mozilla.com 10.132.49.112
* buildbot-master66.srv.releng.usw2.mozilla.com 10.132.50.247

which are not yet fully migrated (bug 966070)

Comment 5

[Chris AtLee [:catlee]]

Comment on attachment 8400498 [details] [diff] [review]
[puppet] Bug 990775 - remove bm66 IP from signing_new_token_allowed_ips.patch

in production