Need to patch: treeherder1.db.scl3.mozilla.com so we need to failover, patch and fail back (probably about 30 mins to patch, but failover causes less than a minute-long outage) Owners: :fubar, :mdoglio, :camd When can this be done?
Work on treeherder has the potential to close trees; NI on jgriffin to schedule.
(I suspect EST morning will be best time of day, based on a convo we just had with sheriffs regarding when to push code changes to prod.)
I agree EST morning (not on a Friday) is probably the best time; ed or Ryan, do you disagree?
OK, I will fail over tomorrow morning at 7 am Pacific, and fail back Monday at 7 am Pacific. I assume silence = acceptance. Watch this bug for updates.
Before starting, can you drop a ping in #treeherder? It is especially helpful to the sheriffs to know when work's being done on the infra. Thx!
Yes! I missed today's window, sadly. (calendar reminder didn't remind me!)
Approved by the CAB for the date/time mentioned in the CAB spreadsheet.
With sheeri's & treeherder's permission. I failed over and failed back to the original master/slave config, after upgrading both mysql servers.
2 years ago