1852518 - Airflow task search_term_data_validation (since August) and search_term_data_validation_v2 (since September) failing

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, defect)

Description

[Krzysztof Ignasiak [:kik]]

Airflow task search_term_data_validation (since August) and search_term_data_validation_v2 (since September) failing

Task link:

• search_term_data_validation_v2

• search_term_data_validation

It appears these DAGs are have been failing for a while, it is unclear what is causing this issue.

Comment 1

[Krzysztof Ignasiak [:kik]]

:ctroy since both are failing, may I suggest that we disable search_term_data_validation and focus on getting search_term_data_validation_v2 to run?

Comment 2

[Krzysztof Ignasiak [:kik]]

Attachment: search-term-data-validation-v2-pods.png

Comment 3

[Krzysztof Ignasiak [:kik]]

Attachment: search-term-data-validation-v2-pod-stats.png

Comment 4

[Krzysztof Ignasiak [:kik]]

I just had a quick look, and it appears there are pods for search_term_data_validation_v2 which have run and completed successfully in the recent days (attached screenshots). Unfortunately, no logs are showing when investigating the logs tab so it's hard to say if anything actually run or what was done by the pod.

This job will need to be investigated further.

Comment 5

[Chelsea Troy]

(In reply to Krzysztof Ignasiak [:kik] from comment #1)

:ctroy since both are failing, may I suggest that we disable search_term_data_validation and focus on getting search_term_data_validation_v2 to run?

Yes; this is the purpose that search_term_data_validation_v2 was built for :). I have left it inabled so it is impossible to forget to remove it once v2 is working, but I'm not strongly against disabling it.

Comment 6

[Chelsea Troy]

(In reply to Krzysztof Ignasiak [:kik] from comment #4)

I just had a quick look, and it appears there are pods for search_term_data_validation_v2 which have run and completed successfully in the recent days (attached screenshots). Unfortunately, no logs are showing when investigating the logs tab so it's hard to say if anything actually run or what was done by the pod.

This job will need to be investigated further.

I'm about to check the output table that that job, if successful, would have dumped into.

Comment 7

[Krzysztof Ignasiak [:kik]]

Hey :ctroy,

If I recall correctly these DAGs are no longer active, should this issue be marked as WONTFIX or INVALID?

Thanks!

Comment 8

[Chelsea Troy]

I'll say WONTFIX!