Closed Bug 1635206 Opened 5 years ago Closed 5 years ago

Investigate missing environment fields in new profile pings

Categories

(Data Platform and Tools :: General, defect, P2)

defect
Points:
1

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: wlach, Assigned: ascholtz)

Details

(Whiteboard: [dataquality])

Attachments

(2 files)

Attached image image.png

The missing columns dashboard shows a large number of environment fields are missing from the new-profile ping.

This is really confusing to me, as it seems like the new-profile ping has the environment schema fully laid out?

https://github.com/mozilla-services/mozilla-pipeline-schemas/blob/master/templates/telemetry/new-profile/new-profile.4.schema.json

Indeed it does, these fields are updated by the schema-generator to be coerced. The incoming values are of multiple types so we can't set the schema elements to be just one. As such we coerce in the pipeline and have the values in the tables be that coerced type.

To do this, we need to add the new-profile ping to this list: https://github.com/mozilla/mozilla-schema-generator/blob/master/common_pings.json

Assignee: nobody → ascholtz
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Component: Datasets: General → General
Whiteboard: [data-quality] → [dataquality]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: