VPN connections to Amazon VPCs are down

RESOLVED FIXED

Status

Infrastructure & Operations
NetOps
RESOLVED FIXED
5 years ago
4 years ago

People

(Reporter: rail, Assigned: casey)

Tracking

Details

(Reporter)

Description

5 years ago
It looks like VPN connections in all used Amazon regions are down at the moment. As a result no routing from SCL3 to AWS. Filing as a blocker because the trees are closed, sorry.

Updated

5 years ago
Assignee: network-operations → shyam
Can you provide additional steps to verify? Or what you tried to come to this conclusion?
Arzhel was online and already poking. He paged Casey who's now looking into the issue.
Assignee: shyam → cransom
(Assignee)

Comment 3

5 years ago
I'm unsure as to cause (bug, it appears), but all the vpn connections on fw1.releng.scl3 were no longer passing traffic.  I cleared SA's to try and rebuild the connections but ultimately ended up disabling the VPNs and re-enabling the config which brought them back up.  I've got logs from the event and will scrounge around on juniper's KB to see if there is a known PR for this behavior.
Status: NEW → ASSIGNED
Thanks Casey, jobs are running again. I've reopened the trees.
(Reporter)

Comment 5

5 years ago
Sorry, I've been offline to help with debugging the problem. The VPN connections look OK now. Not a blocker anymore.
Severity: blocker → normal
(Assignee)

Comment 6

5 years ago
I wasn't able to track down a specific PR related to our specific errors however there were a number of ipsec bug fixes and enhancements between 11.1 and 11.4.  Our goal is to update this and other remaining firewalls to 11.4 during a window that we are trying to schedule for 12/16.  Making this bug dependent on that work.
Status: ASSIGNED → RESOLVED
Last Resolved: 5 years ago
Depends on: 815688
Resolution: --- → FIXED
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.