1601829 - Denied: Table moz-fx-data-shar-nonprod-efed:payload_bytes_error.* for document_sample_nonprod_v1 airflow query

Status: RESOLVED FIXED

(Data Platform and Tools Graveyard :: Operations, task)

Description

[Anthony Miyaguchi [:amiyaguchi]]

The document_sample.document_sample_nonprod_v1 query was recently added to bigquery-etl and telemetry-airflow. It is currently hitting payload_bytes_error for access to payload items that have failed validation. Because of this, this job will not run on the default Kubernetes cluster.

[2019-12-06 00:39:43,291] {logging_mixin.py:95} INFO - [2019-12-06 00:39:43,291] {pod_launcher.py:121} INFO - Event: document-sample-nonprod-v1-e1ce31d2 had an event of type Running
[2019-12-06 00:39:44,200] {logging_mixin.py:95} INFO - [2019-12-06 00:39:44,200] {pod_launcher.py:104} INFO - BigQuery error in query operation: Error processing job
[2019-12-06 00:39:44,202] {logging_mixin.py:95} INFO - [2019-12-06 00:39:44,202] {pod_launcher.py:104} INFO - 'moz-fx-data-shared-prod:bqjob_r595859e099d30cf4_0000016ed8a5eb7e_1': Access
[2019-12-06 00:39:44,203] {logging_mixin.py:95} INFO - [2019-12-06 00:39:44,203] {pod_launcher.py:104} INFO - Denied: Table moz-fx-data-shar-nonprod-efed:payload_bytes_error.*: User does not
[2019-12-06 00:39:44,204] {logging_mixin.py:95} INFO - [2019-12-06 00:39:44,203] {pod_launcher.py:104} INFO - have permission to query table

This job should be able to run to populate the moz-fx-data-shared-prod.monitoring.document_sample_nonprod_v1 table.

Comment 1

[Wesley Dawson [:whd]]

Most likely this was resolved by the work in bug #1613225.