1055620 - Fix statsd destination on glow servers

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Engagement, task)

Description

[C. Liang [:cyliang]]

The statsd destination server has recently changed from graphite1.private.phx1.mozilla.com to graphite6.private.phx1.mozilla.com.  Please update the settings for both the development and production instances of glow.

I was able to find the following references:

glow1.dev.dmz.phx1.mozilla.com
  /home/mrburns/smithers/smithers/conf/server.py:
      STATSD_HOST = getenv('STATSD_HOST', 'graphite1.private.phx1.mozilla.com')

glow1.dmz.phx1.mozilla.com
  /data/www/webwewant.mozilla.org/project/mrburns/smithers/smithers/conf/server.py:
    STATSD_HOST = 'graphite1.private.phx1.mozilla.com'

Comment 1

[Paul [:pmac] McLanahan]

There are a lot of sites using statsd including this one, but I manage a couple others. Does this mean that all of our (mozilla) websites have to change a setting? Do I need to file bugs for bedrock (www.mozilla.org) and basket (basket.m.o) as well?

Comment 2

[Paul [:pmac] McLanahan]

I've updated the following servers:

glow1.dev.dmz.phx1.mozilla.com
glow1.dmz.phx1.mozilla.com
glow1.dmz.scl3.mozilla.com

Comment 3

[C. Liang [:cyliang]]

I don't think that you'll need to open bugs for bedrock and basket: I *think* that I've gotten those already.   I didn't make changes to the glow servers since it looked like these were managed more directly by y'all. =)

Comment 4

[Paul [:pmac] McLanahan]

Ah. Indeed they are. Thanks!

Comment 5

[Eric Ziegenhorn :ericz]

glow1.dmz.phx1 is still sending to statsd on graphite1, perhaps services need to be restarted?

Comment 6

[Paul [:pmac] McLanahan]

I restarted things. Code might be behind latest. Looking at it now.

Comment 7

[Paul [:pmac] McLanahan]

I believe this should now be really fixed. Mind checking again :ericz?

Comment 8

[Eric Ziegenhorn :ericz]

I don't see it at the moment, though these things aren't always constant.  I'll check a few more times then declare this fixed, thanks!

Comment 9

[Eric Ziegenhorn :ericz]

Looks good still, thanks.