THere are currently 4 esx host down or unavailable. Mainly ip-ns01-02 are down.
ip-ns01 and 02 being down broke all of internal dns for phx1. I temporarily aliased 10.8.75.21 to natasha and restarted named for resolution to pick back up until the main nameservers come back up.
Summary: esx1-4.private.corp outage → ip-ns01 and ns02 are having disk volume issues
I was thinking this was on HCI. But its on IP-Ops02. It appears the virtual disk needs more space, before they vms can start. At least thats what Vmware is reporting
ip-esx01.phx.mozilla.com ip-esx01.phx.mozilla.com are the affected esx hosts
Adding the chain since this caused a PHX1 HCI outage
This has been fixed
Assignee: server-ops → dparsons
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
bug 763328 is followup for removing this as a SPOF.
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.