1263711 - Please remove the bouncer database hosts

Status: RESOLVED FIXED

(Infrastructure & Operations :: MOC: Service Requests, task)

Description

[Pythian Team73]

We are decommissioning the bouncer database hosts. We got the backup, removed mysql and the related data. Nagios checks are removed.

Please remove following hosts:
bouncer[1-4].db.scl3.mozilla.com

We will need to remove load balancer of the bouncer as well.

Comment 1

[Greg Cox [:gcox]]

Decom checklist, please.

Comment 2

[Vinh Hua [:vinh]]

bouncer1.db.scl3.mozilla.com has address 10.22.70.139
bouncer2.db.scl3.mozilla.com has address 10.22.70.138
bouncer3.db.scl3.mozilla.com has address 10.22.70.141
bouncer4.db.scl3.mozilla.com has address 10.22.70.140

Phase 1
-nagios already removed
-new relic monitoring removed
-backups and storage already removed
-puppet disabled for +365d
-hosts powered down

Comment 3

[Vinh Hua [:vinh]]

Phase 2
-dns records deleted
-inventory records deleted
-no zlb VIPS
-removed from RHN portal
-removed from puppet dashboard
-didn't find any node definitions in puppet
-pending ACL deletions (bug 1267944)
-pending VM deletion

Comment 4

[Greg Cox [:gcox]]

VMs deleted from disk and spreadsheet.

Check zeus again:
bouncer-ro-vip.db.scl3.mozilla.com 	A 	10.22.70.29
bouncer-rw-vip.db.scl3.mozilla.com 	A 	10.22.70.32

Comment 5

[Vinh Hua [:vinh]]

Thanks gcox, I was searching under the wrong zlb cluster (external).  The correct location is the internal zlb cluster.

-vips removed from ZLB
-vips DNS deleted
-vips removed from nagios

Modified Paths:
--------------
   puppet/trunk/modules/nagios/manifests/hosts/scl3.pp

Modified: puppet/trunk/modules/nagios/manifests/hosts/scl3.pp
===================================================================
--- puppet/trunk/modules/nagios/manifests/hosts/scl3.pp	2016-05-03 20:00:23 UTC (rev 117742)
+++ puppet/trunk/modules/nagios/manifests/hosts/scl3.pp	2016-05-03 20:07:14 UTC (rev 117743)
@@ -8228,14 +8228,6 @@
                'graphite-web-scl3',
            ]
        },
-        'bouncer-ro-vip.db.scl3.mozilla.com' => {
-            parents => 'zlb1.ops.scl3.mozilla.com',
-            hostgroups => [ 'zeus-vips' ]
-        },
-        'bouncer-rw-vip.db.scl3.mozilla.com' => {
-            parents => 'zlb1.ops.scl3.mozilla.com',
-            hostgroups => [ 'zeus-vips' ]
-        },
        'bugzilla-reporting-vip.db.scl3.mozilla.com' => {
            parents => 'zlb1.ops.scl3.mozilla.com',
            hostgroups => [ 'zeus-vips' ]