1206783 - Decommission captain.mozilla.org

Status: RESOLVED FIXED

(Infrastructure & Operations :: IT-Managed Tools, task)

Description

[Osmose [:osmose, :mkelly]]

The only sites available for deploying on Captain are careers and Captain itself, and I've confirmed that the careers team uses chief for their deploys instead. There's no interest in using Captain for other sites, and most sites are moving towards deploying on AWS or Heroku or other platforms that won't benefit from Captain.

Let's kill it! This will include both decommissioning the main Captain site and the dev site, and removing the Shove daemons running on Careers.

Comment 1

[Ryan Watson [:w0ts0n]]

the ssl certificate for captain.mozilla.org has been successfully revoked.
So SSL is broken now. So I'll begin decom today.

Comment 2

[Ryan Watson [:w0ts0n]]

Target decom: 

Domains: 
captain.mozilla.org
captain.allizom.org

ZLB's:
captain-zlb.webapp.scl3.mozilla.com
captain-stage-zlb.webapp.scl3.mozilla.com

Machines and IP's:
captain-dev-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.49 	
captain-dev.allizom.org 	A 	10.22.81.49 	
captain-stage-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.50 	
captain-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.51 	
captain1.dev.webapp.scl3.mozilla.com 	A 	10.22.81.45 	
captain1.stage.webapp.scl3.mozilla.com 	A 	10.22.81.46 	
captain1.webapp.scl3.mozilla.com 	A 	10.22.81.47 	
captain2.webapp.scl3.mozilla.com 	A 	10.22.81.48 	
captainadm.private.scl3.mozilla.com 	A 	10.22.75.43

Puppet/Files:
webapp/files/captain/admin/etc-cron.d/captain.mozilla.org
webapp/files/captain/etc-httpd/domains/captain.mozilla.org.conf
webapp/files/captain-dev/etc-httpd/domains/captain-dev.allizom.org.conf
webapp/files/captain-stage/etc-httpd/domains/captain.allizom.org.conf
webapp/manifests/admin/captain.pp
webapp/manifests/captain/logger.pp
webapp/manifests/captain/prod.pp
webapp/manifests/captain.pp
webapp/manifests/shove/captain.pp
webapp/templates/captain/etc/motd.erb
webapp/templates/captain-dev/etc/motd.erb
webapp/templates/captain-stage/etc/motd.erb

Comment 3

[Ryan Watson [:w0ts0n]]

* Removed nagios checks, no pingdom checks
* Removed newrelic checks
* filed bug: 1207605 to have DB's removed.
* checked for backups
* powered down the machines. Waiting before decoming the IP's and ACL's. 




other notes:
zlbs:
captain-dev-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.49
captain-stage-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.50
captain-zlb.webapp.scl3.mozilla.com 	A 	10.22.81.51


Mounts:
captainadm
10.22.75.91:/captain/dev     50G  5.6M   50G   1% /mnt/netapp_dev
10.22.75.91:/captain/prod    50G  6.0M   50G   1% /mnt/netapp
10.22.75.91:/captain/stage   50G  5.7M   50G   1% /mnt/netapp_stage

captain1.webapp.scl3
10.22.81.112:/captain/prod   50G  6.0M   50G   1% /mnt/netapp

captain2.webapp.scl3
10.22.81.112:/captain/prod   50G  6.0M   50G   1% /mnt/netapp

captain1.dev.webapp.scl3
10.22.81.112:/captain/dev   50G  5.6M   50G   1% /mnt/netapp_dev

captain1.stage.webapp.scl3
10.22.81.112:/captain/stage   50G  5.7M   50G   1% /mnt/netapp_stage

Comment 4

[Ryan Watson [:w0ts0n]]

All DNS entries removed:
 * Domains
 * ZLB's
 * Machines

VM's
 * Filed bugs for Vm's to be deleted and removed from inventory (as per discussion with cknowles)
  
 
ZLB
 * removed zlb's, virtual servers and pools.

RHN
 * Deleted the systems from the RHN

Puppet Dashboard
 * delete from the dashboard

Found some more puppet stuff that I need to look through and also file a netops bug for flows to be removed.

Comment 5

[Ryan Watson [:w0ts0n]]

Removed left over stuff from puppet. 
I think we are done here.

Comment 6

[Osmose [:osmose, :mkelly]]

\o/