Closed
Bug 1816398
Opened 3 years ago
Closed 3 years ago
Airflow task bqetl_fxa_events.firefox_accounts_derived__fxa_users_services_first_seen__v2 failed on 2023-02-10
Categories
(Data Platform and Tools :: General, defect)
Data Platform and Tools
General
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: kik, Assigned: kik)
Details
(Whiteboard: [airflow-triage])
Airflow task bqetl_fxa_events.firefox_accounts_derived__fxa_users_services_first_seen__v2 failed on 2023-02-10
Log extract:
Waiting on bqjob_r104d4b3569246f8_000001863e230c2e_1 ... (2s) Current status: DONE
[2023-02-11, 01:42:13 UTC] {{pod_manager.py:226}} INFO - BigQuery error in query operation: Error processing job 'moz-fx-data-shared-
[2023-02-11, 01:42:13 UTC] {{pod_manager.py:226}} INFO - prod:bqjob_r104d4b3569246f8_000001863e230c2e_1': Some rows belong to different
[2023-02-11, 01:42:13 UTC] {{pod_manager.py:226}} INFO - partitions rather than destination partition
[2023-02-11, 01:42:14 UTC] {{pod_manager.py:226}} INFO - Traceback (most recent call last):
|
Assignee | |
Comment 1•3 years ago
|
||
PR opened to fix this issue:
https://github.com/mozilla/bigquery-etl/pull/3588
|
|
Assignee | |
Comment 2•3 years ago
|
||
The tasks we'll be re-run once the manual backfill for fxa_users_services_daily_v2 and fxa_users_services_first_seen_v2 is completed from 2019-03-01 until 2023-02-12.
|
|
Assignee | |
Comment 3•3 years ago
|
||
Backfill should be now complete. Run the following backfill commands:
# firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2019-03-01 --end_date=2019-08-01 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2019-08-01 --end_date=2020-01-01 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2020-01-01 --end_date=2021-01-01 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2021-01-01 --end_date=2022-01-01 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2022-01-01 --end_date=2023-01-01 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# ./bqetl query backfill --start_date=2023-01-01 --end_date=2023-02-15 --parallelism=8 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_daily_v2
# firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2019-03-01 --end_date=2019-08-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2019-08-01 --end_date=2020-01-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2020-01-01 --end_date=2021-01-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2021-01-01 --end_date=2022-06-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2021-06-01 --end_date=2021-06-12 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2021-06-12 --end_date=2022-01-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2022-01-01 --end_date=2022-07-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2022-07-01 --end_date=2023-01-01 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
# ./bqetl query backfill --start_date=2023-01-01 --end_date=2023-02-20 --parallelism=1 --project-id=moz-fx-data-shared-prod firefox_accounts_derived.fxa_users_services_first_seen_v2
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
You need to log in
before you can comment on or make changes to this bug.
Description
•