Closed Bug 1805253 Opened 3 years ago Closed 3 years ago

Investigate why 'payload.dns_data' column increasing size in `dnssec_study_v1_v4` table

Categories

(Data Platform and Tools :: General, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: efilho, Unassigned)

Details

(Whiteboard: [dataquality])

Attachments

(1 file)

Attached image column_size_diff.png —

During the Platform Health Check meeting we noticed a constant increase of around 150GB/day of the payload.dns_data column. We should investigate whether this is expected.

Possibly unrelated but I did see https://github.com/mozilla-services/mozilla-pipeline-schemas/pull/753 which is DNS-related land a few weeks ago. Perhaps the increase in main correlates to updates to that ping.

Correcting bug title to reflect the column is in telemetry_derived.dnssec_study_v1_v4 table, not the main_v4 table.

Summary: Investigate why 'payload.dns_data' column increasing size in main ping tbl → Investigate why 'payload.dns_data' column increasing size in `dnssec_study_v1_v4` table

Experiment is currently running but will be shut off in the near future. Table growth is expected.

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → WONTFIX
Whiteboard: [data-quality] → [dataquality]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: