1091412 - Uptime on fuzzer-linux7.sec.scl3.mozilla.com is WARNING: WARNING: Linux fuzzer-linux7.sec.scl3.mozilla.com 3.2.0-45-generic - up 5 minutes

Status: RESOLVED FIXED

(Infrastructure & Operations :: MOC: Problems, task)

Description

[MOC Nagios API]

Automated alert report from nagios1.private.scl3.mozilla.com:

Hostname: fuzzer-linux7.sec.scl3.mozilla.com
Service:  Uptime
State:    WARNING
Output:   WARNING: Linux fuzzer-linux7.sec.scl3.mozilla.com 3.2.0-45-generic - up 5 minutes

Runbook:  http://m.allizom.org/Uptime

Comment 1

[david garvey:dgarvey]

The /var/log/messsages:

Very strange:
Oct 29 22:44:25 fuzzer-linux7 lldpd[1476]: lldp_decode: unknown org tlv received on eth0


dgarvey@fuzzer-linux7:~$ tail -20 /var/log/messages
Oct 29 22:44:02 fuzzer-linux7.sec.scl3.mozilla.com kernel: [   50.767785] auditd (1661): /proc/1661/oom_adj is deprecated, please use /proc/1661/oom_score_adj instead.
Oct 29 22:44:02 fuzzer-linux7 auditd[1661]: Init complete, auditd 1.7.18 listening for events (startup state enable)
Oct 29 22:44:02 fuzzer-linux7 audispd: plugin /sbin/audisp-cef terminated unexpectedly
Oct 29 22:44:02 fuzzer-linux7.sec.scl3.mozilla.com kernel: [   50.896514] ip_tables: (C) 2000-2006 Netfilter Core Team
Oct 29 22:44:02 fuzzer-linux7.sec.scl3.mozilla.com kernel: [   50.912047] ip6_tables: (C) 2000-2006 Netfilter Core Team
Oct 29 22:44:03 fuzzer-linux7.sec.scl3.mozilla.com kernel: [   52.480035] uhci_hcd 0000:02:00.4: Controller not stopped yet!
Oct 29 22:44:25 fuzzer-linux7 lldpd[1476]: lldp_decode: unknown org tlv received on eth0
Oct 29 22:45:32 fuzzer-linux7 hpasmlited[1452]: hpDeferSPDThread: End of Collecting DIMM SPD data.
Oct 29 22:49:37 fuzzer-linux7 sshd[1888]: Set /proc/self/oom_score_adj to 0
Oct 29 22:49:37 fuzzer-linux7 sshd[1888]: Connection from 10.22.75.6 port 40986
Oct 29 22:49:39 fuzzer-linux7 sshd[1888]: Found matching RSA key: d6:be:76:22:0e:6c:b5:c7:34:8d:39:cc:67:78:8f:cc
Oct 29 22:49:39 fuzzer-linux7 sshd[1888]: Postponed publickey for dgarvey from 10.22.75.6 port 40986 ssh2 [preauth]
Oct 29 22:49:39 fuzzer-linux7 sshd[1888]: Found matching RSA key: d6:be:76:22:0e:6c:b5:c7:34:8d:39:cc:67:78:8f:cc
Oct 29 22:49:39 fuzzer-linux7 sshd[1888]: Accepted publickey for dgarvey from 10.22.75.6 port 40986 ssh2
Oct 29 22:49:39 fuzzer-linux7 dbus[831]: [system] Activating service name='org.freedesktop.ConsoleKit' (using servicehelper)
Oct 29 22:49:39 fuzzer-linux7 dbus[831]: [system] Activating service name='org.freedesktop.PolicyKit1' (using servicehelper)
Oct 29 22:49:39 fuzzer-linux7 polkitd[1958]: started daemon version 0.104 using authority implementation `local' version `0.104'
Oct 29 22:49:39 fuzzer-linux7 dbus[831]: [system] Successfully activated service 'org.freedesktop.PolicyKit1'
Oct 29 22:49:39 fuzzer-linux7 dbus[831]: [system] Successfully activated service 'org.freedesktop.ConsoleKit'
Oct 29 22:49:39 fuzzer-linux7 sshd[1888]: User child is on pid 1976
dgarvey@fuzzer-linux7:~$

Comment 2

[david garvey:dgarvey]

root@fuzzer-linux7:/etc/nagios/nrpe.d# w
 23:00:21 up 17 min,  1 user,  load average: 0.01, 0.03, 0.05
USER     TTY      FROM              LOGIN@   IDLE   JCPU   PCPU WHAT
dgarvey  pts/0    admin1a.private. 22:49    0.00s  0.77s  0.01s sshd: dgarvey [priv]
root@fuzzer-linux7:/etc/nagios/nrpe.d#

Comment 3

[Ashish Vijayaram [:ashish]]

Being tracked in Bug 896188.