1877339 - schema error in `telemetry.sync_v4` for #/payload/os/distro

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Sean Rose [:srose]]

expected type: String, found: Null

Comment 1

[Ben Wu [:benwu]]

Should be fixed by https://github.com/mozilla-services/mozilla-pipeline-schemas/pull/810. I'll check again when the schema/dataflow job redeploys

Comment 2

[Ben Wu [:benwu]]

The errors stopped when dataflow redeployed at around 2024-05-01 19:00:00 UTC

SELECT
  document_type,
  DATE_TRUNC(submission_timestamp, HOUR),
  COUNT(*),
FROM
  `moz-fx-data-shared-prod.payload_bytes_error.telemetry`
WHERE
  DATE(submission_timestamp) BETWEEN '2024-05-01' AND '2024-05-02'
  AND (
    error_message = 'org.everit.json.schema.ValidationException: #/payload/os/distro: expected type: String, found: Null'
    OR error_message = 'org.everit.json.schema.ValidationException: #/environment/system/os/distro: expected type: String, found: Null'
  )
GROUP BY document_type, 2
ORDER BY 2, document_type

Related fix in firefox is bug 1894412