867972 - mdn: chief (http://developeradm.private.scl3.mozilla.com) is down

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task, P3)

Description

[Luke Crouch [:groovecoder]]

I think it's just chief/web server? I'm connected to Mozilla-MPT.

ping:
--- developeradm.private.scl3.mozilla.com ping statistics ---
10 packets transmitted, 10 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 65.861/66.824/67.842/0.611 ms

But Firefox says "Firefox can't establish a connection to the server at developeradm.private.scl3.mozilla.com."

traceroute:
traceroute to developeradm.private.scl3.mozilla.com (10.22.75.51), 64 hops max, 52 byte packets
 1  10.2.21.1 (10.2.21.1)  64.895 ms  60.921 ms  66.398 ms
 2  v2.core1.sj.mozilla.com (63.245.208.129)  63.026 ms  62.018 ms  60.813 ms
 3  gr-0-0-0-0.border1.scl3.mozilla.net (10.0.0.74)  62.633 ms  62.287 ms  62.449 ms
 4  * * *
 5  * * *
 ...

Comment 1

[Brandon Burton [:solarce]]

Despite httpd being installed puppet wasn't ensuring it would start on boot or was running.

This VM was HA failed over earlier this week and so httpd did not start on reboot

I've fixed this

bburton@ironbars [09:06:35] [~/code/mozilla/sysadmins/puppet/trunk]
-> % svn diff
Index: modules/webapp/manifests/admin/developer.pp
===================================================================
--- modules/webapp/manifests/admin/developer.pp	(revision 64768)
+++ modules/webapp/manifests/admin/developer.pp	(working copy)
@@ -38,6 +38,12 @@
             port => 8000;
     }

+    service {
+      "httpd":
+        enable => true,
+        ensure => running;
+    }
+

bburton@ironbars [09:06:45] [~/code/mozilla/sysadmins/puppet/trunk]
-> % svn ci -m "making sure httpd is running, bug 867972"
Sending        trunk/modules/webapp/manifests/admin/developer.pp
Transmitting file data .
Committed revision 64772.

Notice: /Stage[main]/Webapp::Admin::Developer/Service[httpd]/ensure: ensure changed 'stopped' to 'running'
Notice: Finished catalog run in 29.87 seconds
[[e-mail]3 ~]#

Puppet will now ensure it is running and starts at boot

http://developeradm.private.scl3.mozilla.com/chief/developer.stage now loads