Asterisk DUNDi connectivity on pbx1.voip.mtv2.mozilla.com is CRITICAL: 10.241.2.11 UNREACHABLE

RESOLVED FIXED

Status

RESOLVED FIXED
4 years ago
2 years ago

People

(Reporter: nagiosapi, Unassigned)

Tracking

Details

(Whiteboard: [id=nagios1.private.scl3.mozilla.com:424490], URL)

(Reporter)

Description

4 years ago
Automated alert report from nagios1.private.scl3.mozilla.com:

Hostname: pbx1.voip.mtv2.mozilla.com
Service:  Asterisk DUNDi connectivity
State:    CRITICAL
Output:   10.241.2.11 UNREACHABLE

Runbook:  http://m.allizom.org/Asterisk+DUNDi+connectivity

Comment 1

4 years ago
Pek is experiencing slowness right now.

[dgarvey@pbx1.voip.sfo1 ~]$ sudo /usr/sbin/asterisk -rx 'dundi show peers'
EID                  Host                Port   Model      AvgTime  Status         
00:50:56:bb:64:06    10.22.74.143    (S) 4520   Symmetric  Unavail  OK (3 ms)      
00:19:bb:38:52:92    10.241.2.11     (S) 4520   Symmetric  Unavail  UNREACHABLE    
00:25:90:99:12:7a    10.249.40.4     (S) 4520   Symmetric  Unavail  OK (177 ms)    
ac:16:2d:8d:2d:5c    10.248.40.4     (S) 4520   Symmetric  Unavail  OK (18 ms)     
78:e3:b5:18:c3:e4    10.246.40.4     (S) 4520   Symmetric  Unavail  OK (140 ms)    
9c:8e:99:1b:25:60    10.245.40.4     (S) 4520   Symmetric  Unavail  OK (191 ms)    
80:c1:6e:81:a3:f0    10.243.40.4     (S) 4520   Symmetric  Unavail  OK (141 ms)    
78:e3:b5:18:a3:d0    10.244.40.4     (S) 4520   Symmetric  Unavail  OK (58 ms)     
b4:b5:2f:51:f2:0c    10.242.40.4     (S) 4520   Symmetric  Unavail  OK (61 ms)     
78:e3:b5:18:24:98    10.252.40.4     (S) 4520   Symmetric  Unavail  OK (5 ms)      
10 dundi peers [9 online, 1 offline, 0 unmonitored]
[dgarvey@pbx1.voip.sfo1 ~]$ dig -x 10.241.2.11

; <<>> DiG 9.8.2rc1-RedHat-9.8.2-0.23.rc1.el6_5.1 <<>> -x 10.241.2.11
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 37536
;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 3, ADDITIONAL: 2

;; QUESTION SECTION:
;11.2.241.10.in-addr.arpa.	IN	PTR

;; ANSWER SECTION:
11.2.241.10.in-addr.arpa. 3600	IN	PTR	cn-adminoffice01.cn.mozilla.com.

;; AUTHORITY SECTION:
2.241.10.in-addr.arpa.	3600	IN	NS	ns.cn.mozilla.com.
2.241.10.in-addr.arpa.	3600	IN	NS	ns.ca.mozilla.com.
2.241.10.in-addr.arpa.	3600	IN	NS	ns.mv.mozilla.com.

;; ADDITIONAL SECTION:
ns.cn.mozilla.com.	60	IN	A	10.241.2.11
ns.mv.mozilla.com.	60	IN	A	10.250.0.21

;; Query time: 14 msec
;; SERVER: 10.251.75.5#53(10.251.75.5)
;; WHEN: Sat Sep 27 19:00:23 2014
;; MSG SIZE  rcvd: 176

[dgarvey@pbx1.voip.sfo1 ~]$
(Reporter)

Comment 2

4 years ago
Automated alert acknowledgement: (dgarvey)pek is slow bug1073894
Status: NEW → ASSIGNED

Comment 3

4 years ago
Adam is aware of the issue and suspects it is the link between the office and the datacenter or metrolink.
Status: ASSIGNED → NEW
Assignee: nobody → network-operations
Component: MOC: Incidents → NetOps: Office Carrier
QA Contact: dmoore → jbarnell
Assignee: network-operations → nobody
Component: NetOps: Office Carrier → MOC: Incidents
QA Contact: jbarnell → dmoore
(Reporter)

Comment 4

4 years ago
Automated alert recovery:

Hostname: pbx1.voip.mtv2.mozilla.com
Service:  Asterisk DUNDi connectivity
State:    OK
Output:   10 peers OK
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
(Assignee)

Updated

2 years ago
Component: MOC: Incidents → MOC: Problems
Product: Infrastructure & Operations → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.