767603 - new puppetized logstash.conf template

Status: VERIFIED FIXED

(Cloud Services :: Operations: Miscellaneous, task)

Description

[Rob Miller [:rmiller]]

Attachment: logstash.conf file

The logstash.conf configuration file that is on all of our webheads needs to be tweaked to generate the output that we want to see. Attached is the correct file that should be puppetized so as to be distributed to all of these machines. Some notes:

* The file should be templatized. There are a couple of file output paths specified as '/var/log/<APPNAME>/...'. In these cases <APPNAME> should be the string token commonly used to refer to the application in question (e.g. 'aitc', 'sync', 'tokenserver', 'stokenserver', etc.)

* This config makes use of the 'catchall' filter which is newly added to logstash-metlog as of 0.7. The 0.7 RPM is currently available at r6.build.mtv1.svc.mozilla.com:/home/vng/RPMS/logstash-metlog-0.7-1.x86_64.rpm

Comment 1

[James Bonacci [:jbonacci]]

+1

Would be nice to actually see the logstashed/MetLogged-ified logs in AITC stage, among other locations...

Comment 2

[Pete Fritchman [:petef]]

templatized in puppet + deployed to aitc/token.

I made the changes in puppet for syncweb stage, too, didn't actually kick puppet or verify there.

Comment 3

[James Bonacci [:jbonacci]]

Most definitely have evidence of this work in Stage.
Thanks.