1807693 - Investigate schema errors on `telemetry.third_party_modules_v4: #/payload/processes`

Status: RESOLVED FIXED

(Data Platform and Tools :: General, task)

Description

[Eduardo Filho [:efilho]]

During the Platform Health Check meeting we found telemetry.third_party_modules_v4: #/payload/processes has a count of 8.661 schema errors

Comment 1

[Anna Scholtz [:ascholtz]]

The error is happening due to:

org.everit.json.schema.ValidationException: #/payload/processes/browser.0x14ec/events: expected maximum item count: 50, found: 112

More events than allowed according to the schema get sent

Comment 2

[Anna Scholtz [:ascholtz]]

This number significantly increased with version 108.0.1:

SELECT udf.parse_desktop_telemetry_uri(uri).app_version, udf.parse_desktop_telemetry_uri(uri).app_update_channel, count(*)
FROM `moz-fx-data-shared-prod.monitoring.payload_bytes_error_all`
WHERE document_namespace = 'telemetry'
AND document_type like '%third%'
AND error_message like "%processes%"
AND date(submission_timestamp) = date('2023-01-01')
group by 1, 2
order by 3 desc