1117122 - Maintenance notification from Zayo: links into SJC2 down for maintenance on Jan 31 2015

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: NetOps, task)

Description

[Dave Curado :dcurado]

Zayo will be performing maintenance to their router in SJC2 on Jan 31.
Their notification specifies their equipment, but does not tell us which
of our circuits will be impacted.
I'll see if I can find out more from them.  We have a connection to the
Internet from them at SJC2, and if that's all that is affected, that will not
have impact to our network as we have enough redundancy to handle that.

However, some of circuits from Zayo look like ethernet, but are actually 
L2Circuits through their routers.  So that could mean more than just our
Internet connection could be impacted, which could get interesting.
I'll see what I can learn from them, and update this bug.

Here's the notification from Zayo on this:
Attention:
Please respond within 48 hours to [e-mail] with your approval or request to change the date and/or time of this maintenance event. Providing us with this information will assure us that you have received the notification and will allow us, in a timely manner, to resolve any conflicts arising from this scheduled maintenance.

NOTE: In the event no response is received this maintenance will continue as planned during the following maintenance window(s).

Maintenance Window: 00:00 - 05:00 Pacific

Primary Date: 31 JAN 2015

Backup Date: 1 FEB 2015
Location of Maintenance: San Jose, CA

Reason for Maintenance: Zayo will be performing upgrade JunOS firmware on router er1.sjc2.us

Expected Impact: SA (Service Affecting)

Impact:  Hard Down – UP to 30 Minutes

Service ID: T00539-02

If you have any questions or concerns, please feel free to call the
Zayo Network Control Center at one of the following numbers.

Thank you,

Zayo Maintenance Team | Zayo Group
US Toll free: 1.866.236.2824 Opt 4
US Local: 1.918.295.7191
UK Toll free: +44.0.800.169.1646
Email: [e-mail]
Website: http://www.zayo.com
Online Time Zone Converter: http://www.timezoneconverter.com/cgi-bin/tzc.tzc

Comment 1

[Dave Curado :dcurado]

I spoke to Zayo about this.
The "Service ID" listed in their notification is a legacy circuit id.
They should have used ETYX/076783//ZYO which is the circuit from SJC2 to PDX1.
So, that link will go down, but should have almost no impact to us, as
 - the PDX1 office will be closed at this time
 - this link is a "connect the office back into Mozilla's network" circuit,
   and PDX1 has an IPSec tunnel through the Internet so it should not lose
   any connectivity during this maintenance.

The MOC will see the BGP session from border1.sjc2 to fw1.pdx1 go down though.

Comment 2

[Dave Curado :dcurado]

This work has been rescheduled for:
Primary Date: 07 FEB 2015
Backup Date: 08 FEB 2015

I will make the appropriate changes to the oncall pad right now.

Comment 3

[Dave Curado :dcurado]

this work should be completed by now