1731777 - bqetl_document_sample DAG failing due to permissions on payload_bytes_error

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect, P1)

Description

[Jeff Klukas [:klukas] (UTC-4)]

See recent log.

[2021-09-21 01:03:26,502] {pod_launcher.py:156} INFO - b"BigQuery error in query operation: Error processing job 'moz-fx-data-shared-\n"
[2021-09-21 01:03:26,502] {pod_launcher.py:156} INFO - b"prod:bqjob_r572ad0c50c020f82_0000017c05e106d0_1': Access Denied: Table moz-fx-\n"
[2021-09-21 01:03:26,502] {pod_launcher.py:156} INFO - b'data-shar-nonprod-efed:payload_bytes_error.*: User does not have permission to\n'
[2021-09-21 01:03:26,502] {pod_launcher.py:156} INFO - b'query table moz-fx-data-shar-nonprod-efed:payload_bytes_error.*.\n'

This is expected due to https://mozilla-hub.atlassian.net/browse/DSRE-153

This task will need to be updated to use an authorized view, or retired.

Comment 1

[Jeff Klukas [:klukas] (UTC-4)]

?ni amiyaguchi - It's my understanding that this document sample was intended specifically for CI for mozilla-pipeline-schemas, but that we've now removed that CI. Do you know of any other use cases for these samples? Can we tear down this DAG and the underlying tables?

Comment 2

[Anthony Miyaguchi [:amiyaguchi]]

There are no other use cases for these samples, we can go ahead and tear down the related code for this job.

Comment 3

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/bigquery-etl/pull/2389

Comment 4

[Jeff Klukas [:klukas] (UTC-4)]

This has been removed.