Closed Bug 1647344 Opened 4 years ago Closed 4 years ago

Unique id in redash influxdb measurement name

Categories

(Data Platform and Tools Graveyard :: Operations, defect)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: brian, Assigned: brian)

References

Details

Attachments

(1 file)

In the dataops database in influxdb, I believe there's upwards of 40,000 measurement with names like

redash.db.%(139622728971728
redash.db.%(139622729181520
redash.db.%(139622729218960
redash.db.%(139622729247952

Can you identify the source of these and stop them from being submitted?

Once that is done, can I delete all of the measurements with names prefixed with redash.db.%( ?

Looking at number of measurements in dataops over time, seems the growth stalled in mid-may

We deployed a new release on May 14th 2020 (m28) but I am not seeing any changes related to the statsd instrumentation in the code where I would expect this unless it was removed as part of our migration from celery to rq [1][2]. Including Jannis to make sure.

Is there a way to verify that there were no additional redash.db.%(\d+ metrics being created after May 14th?

[1] https://github.com/mozilla/redash/blob/m28/redash/metrics/database.py#L51
[2] https://github.com/mozilla/redash/blob/m27.2/redash/metrics/celery.py#L56

It seems likely your deploy fixed this, or at least slowed down the rate

My initial attempt at looking for recent data with these measurement names failed, so I emailed InfluxData support for advice.

If you're okay with me deleting these measurements, I could simply do that and see if they start to show up again.

Flags: needinfo?(jthomas)

If you're okay with me deleting these measurements, I could simply do that and see if they start to show up again.

That works for me.

Flags: needinfo?(jthomas)
Depends on: 1649594

I am reassigning this to you Brian since there is no action on my end.

Assignee: jthomas → bpitts
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Product: Data Platform and Tools → Data Platform and Tools Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: