Unique id in redash influxdb measurement name
Categories
(Data Platform and Tools Graveyard :: Operations, defect)
Tracking
(Not tracked)
People
(Reporter: brian, Assigned: brian)
References
Details
Attachments
(1 file)
117.60 KB,
image/png
|
Details |
In the dataops database in influxdb, I believe there's upwards of 40,000 measurement with names like
redash.db.%(139622728971728
redash.db.%(139622729181520
redash.db.%(139622729218960
redash.db.%(139622729247952
Can you identify the source of these and stop them from being submitted?
Once that is done, can I delete all of the measurements with names prefixed with redash.db.%(
?
Assignee | ||
Comment 1•4 years ago
|
||
Looking at number of measurements in dataops over time, seems the growth stalled in mid-may
Comment 2•4 years ago
|
||
We deployed a new release on May 14th 2020 (m28) but I am not seeing any changes related to the statsd instrumentation in the code where I would expect this unless it was removed as part of our migration from celery to rq [1][2]. Including Jannis to make sure.
Is there a way to verify that there were no additional redash.db.%(\d+ metrics being created after May 14th?
[1] https://github.com/mozilla/redash/blob/m28/redash/metrics/database.py#L51
[2] https://github.com/mozilla/redash/blob/m27.2/redash/metrics/celery.py#L56
Assignee | ||
Comment 3•4 years ago
|
||
It seems likely your deploy fixed this, or at least slowed down the rate
My initial attempt at looking for recent data with these measurement names failed, so I emailed InfluxData support for advice.
If you're okay with me deleting these measurements, I could simply do that and see if they start to show up again.
Comment 4•4 years ago
|
||
If you're okay with me deleting these measurements, I could simply do that and see if they start to show up again.
That works for me.
Comment 5•4 years ago
|
||
I am reassigning this to you Brian since there is no action on my end.
Assignee | ||
Comment 6•4 years ago
|
||
Dataops measurement cardinality has been stable, so we can close this.
Updated•2 years ago
|
Description
•