Closed Bug 1480485 Opened 8 years ago Closed 7 years ago

Nagios Monitoring Request: Guardduty Process and LogWarn Monitoring

Categories

(Infrastructure & Operations :: MOC: Service Requests, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: phrozyn, Assigned: nli)

Details

(Whiteboard: [pending action on https://bugzilla.mozilla.org/show_bug.cgi?id=1481081#c8])

We would like to implement the following nagios checks on nagios-eis1 in mdc1: Guardduty Process: Binary execution path: /bin/bash -c cd /opt/mozdef/envs/mozdef/mq; source /opt/mozdef/envs/mozdef/bin/activate; uwsgi --ini guardduty.ini Guardduty Error Log: Log path: /var/log/mozdef/guardduty.log String to check for: Trace
No longer blocks: 1480487
Assignee: nobody → nli
Status: NEW → ASSIGNED
check added in commit f5aed7cebb42217d26567c34634c6d31dade47d6 Ran into the same issue as of bug 1481081#c3 Alicia, Could you please add the -r flag to bypass the .gz files as jlaz comment on bug 1481081#c3 Thank you very much. <nli> Ni-Ya Li (Linear, 李霓雅) nagios-eis-mdc1: status mozdef*:*guardduty* 14:11 nli: [Unknown] mozdef1.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180715.gz: Permission denied Last Checked: 2018-08-08 06:09:57 UTC 14:11 nli: [Unknown] mozdef2.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-08 06:10:32 UTC 14:11 nli: [Unknown] mozdef3.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-08 06:11:06 UTC 14:11 nli: [Unknown] mozdef4.private.mdc1.mozilla.com:MozDef guardduty log errors is OK - Last Checked: 1970-01-01 00:00:00 UTC 14:11 nli: [Unknown] mozdef5.private.mdc1.mozilla.com:MozDef guardduty log errors is OK - Last Checked: 1970-01-01 00:00:00 UTC 14:11 nli: [Unknown] mozdef6.private.mdc1.mozilla.com:MozDef guardduty log errors is OK - Last Checked: 1970-01-01 00:00:00 UTC 14:11 nli: [Unknown] mozdef7.private.mdc1.mozilla.com:MozDef guardduty log errors is OK - Last Checked: 1970-01-01 00:00:00 UTC 14:11 nli: [Unknown] mozdef8.private.mdc1.mozilla.com:MozDef guardduty log errors is OK - Last Checked: 1970-01-01 00:00:00 UTC
The -r flag does not work, please see bug https://bugzilla.mozilla.org/show_bug.cgi?id=1481081
(talked to Maryann during 1:1, NI :fauweh and :jlaz for help) Keegan, Justine, It seems bug 1481081 you two are working on affect this monitoring. Would you be able to help take a look at this as well please? Thank you very much. <nli> Ni-Ya Li (Linear, 李霓雅) nagios-eis-mdc1: status mozdef*:*guardduty* <nagios-eis-mdc1> nli: [Unknown] mozdef1.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:09:57 UTC nli: [Unknown] mozdef2.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:01:47 UTC nli: [Unknown] mozdef3.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:01:07 UTC nli: [Unknown] mozdef4.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:02:16 UTC nli: [Unknown] mozdef5.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:03:25 UTC nli: [Unknown] mozdef6.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:04:02 UTC nli: [Unknown] mozdef7.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:04:52 UTC nli: [Unknown] mozdef8.private.mdc1.mozilla.com:MozDef guardduty log errors is UNKNOWN - UNKNOWN: logwarn(1) error: /var/log/mozdef/guardduty.log-20180722.gz: Permission denied Last Checked: 2018-08-24 06:05:41 UTC
Flags: needinfo?(kferrando)
Flags: needinfo?(jlaz)
This work is pending action on :phrozyn per https://bugzilla.mozilla.org/show_bug.cgi?id=1481081#c8 This is an interesting time to decide whether to close the bug, as the monitor is actually implemented, but not functioning correctly due to the issues mentioned in the bug you referenced. Keep this bug open, but feel free to close it once the issue is addressed in bug 1481081. Once the fix is in place, just verify that this check is green and close out.
Flags: needinfo?(jlaz)
Whiteboard: [pending action on https://bugzilla.mozilla.org/show_bug.cgi?id=1481081#c8]
Flags: needinfo?(kferrando)
We should be good here, based on the comments and resolution on 1481081: "These gzipped alerts should no longer be occurring, I think this bug is safe to close in regards to that issue."
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.