Our New Relic reporting script recently stopped working saying an API key is invalid.
The Marketing account's API key changed, I updated puppet with the new value, verified it works and re-ran the script/email.
Apologies for the lack of cross-team communication and coordination there. Will you please update the key in the server configs for sumo and mdn as well?
We did some digging and the New Relic agents appear to authenticate with a "license key" which was not changed like the "API key" was. Therefore, we don't know why we saw the failure and then recovery. New Relic has not said there was any outage on their side. Possibly it was a temporary outbound proxy issue in scl3 as nothing in AWS was affected.