921170 - Verify no more telemetry data is going to Bagheera, shut down relay code.

Status: RESOLVED FIXED

(Webtools Graveyard :: Telemetry Server, defect)

Description

[Mark Reid [:mreid]]

We can check the ganglia graphs to make sure the telemetry submission rate goes to zero.

Similarly, we can check the heka graphs on the new servers to make sure submission rate goes up to 100% of expected rate.

We should also verify that data is making its way to the "incoming" bucket, being processed, and getting published.

If everything checks out, shut down the "relay" infrastructure:
- Log in to bagheera[1-4], kill replay consumer
- Log in to mpt-vpn, kill tunnels
- Log in to telemetry-node-server (ec2-54-245-195-188.us-west-2.compute.amazonaws.com), kill tunnels + relay servers

Comment 1

[Mark Reid [:mreid]]

Incoming telemetry submission rate for Bagheera is now zero.

Submission rate on the new servers seems normal, and incoming data is making its way to the production published data bucket.

Relay infrastructure will be shut down presently.

Comment 2

[Mark Reid [:mreid]]

Relays have been shut down.