1866048 - Airflow task bqetl_event_rollup.mozilla_vpn_derived__events_daily__v1 failed for exec_date 2023-11-21

Status: RESOLVED WORKSFORME

(Data Platform and Tools :: General, defect)

Description

[Leli [:Leli]]

Airflow task bqetl_event_rollup.mozilla_vpn_derived__events_daily__v1 failed for exec_date 2023-11-21

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_event_rollup/grid?dag_run_id=scheduled__2023-11-21T03%3A00%3A00%2B00%3A00&task_id=mozilla_vpn_derived__events_daily__v1

Log extract:

Error in query string: Error processing job 'moz-fx-data-shared-prod:bqjob_r2f2bb464c5d8cea9_0000018bf531b922_1': Cannot query rows larger than 100MB limit. 

Comment 1

[Arkadiusz Komarzewski [:akomar]]

We probably need to add the same filter I added in https://github.com/mozilla/bigquery-etl/pull/2333/files to Glean apps queries.

Comment 2

[Leli [:Leli]]

I'm a bit confused about that one because running the query in bigquery seems to work just fine ... do we have stricter limits in Airflow?
or am I doing it wrong?

Comment 3

[Arkadiusz Komarzewski [:akomar]]

Not really if you execute queries in the same project. Are you sure you ran the right query? I checked this earlier today and it failed for me.

EDIT: I tried this query: moz-fx-data-shared-prod:bqjob_r7fd7e5b979f3f846_0000018bf7424c3d_1

Comment 4

[Leli [:Leli]]

I copied the query from github, added the correct execution date in and ran it in my sandbox ... so not exactly what you did ... have to check that out :)

Comment 5

[Mike Williams [:mwilliams]]

This failed again today with the same error:

Error in query string: Error processing job 'moz-fx-data-shared-prod:bqjob_r6acf8d92e652e01a_0000018e35f9e778_1': 
Cannot query rows larger than 100MB limit.

The DAG owner is also out of date.

Comment 6

[Mike Williams [:mwilliams]]

This task succeeded today. Given that it's a resource issue that we don't see most days I think it's probably just intermittent and still worth investigating.