1799081 - Airflow task contextual_services_import.quicksuggest2bq failing since 2022-11-02

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Krzysztof Ignasiak [:kik]]

Airflow task contextual_services_import.quicksuggest2bq failing since 2022-11-02

Error log:

[2022-11-03 01:00:51,416] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 78, in download_suggestions
[2022-11-03 01:00:51,416] {{pod_launcher.py:149}} INFO -     yield KintoSuggestion(**suggestion_data)
[2022-11-03 01:00:51,417] {{pod_launcher.py:149}} INFO - TypeError: __init__() got an unexpected keyword argument 'full_keywords'

Comment 1

[Alessio Placitelli [:Dexter]]

While I created this job when working on Merino, I'm not the right person to fix this nor the current owner :) Either Wil Stucky or Chelsea Troy would be good people to tackle this.

Let me flag them :-)

Comment 2

[Alekhya Kommasani [:Alekhya]]

The failures were caused during an effort to backfill the tables and can be ignored. More details here : https://mozilla.slack.com/archives/C4D5ZA91B/p1667494556325659
I will mark the failed runs as success.

Comment 4

[Frank Bertsch [:frank]]

Looks like a new field has been added and needs to be enabled in Docker-etl:

[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO - Traceback (most recent call last):
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 203, in <module>
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -     main()
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -     return self.main(*args, **kwargs)
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1053, in main
[2022-11-15 01:00:45,180] {{pod_launcher.py:149}} INFO -     rv = self.invoke(ctx)
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -     return ctx.invoke(self.callback, **ctx.params)
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 754, in invoke
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -     return __callback(*args, **kwargs)
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 193, in main
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -     store_suggestions(
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 93, in store_suggestions
[2022-11-15 01:00:45,181] {{pod_launcher.py:149}} INFO -     suggestions = [
[2022-11-15 01:00:45,182] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 93, in <listcomp>
[2022-11-15 01:00:45,182] {{pod_launcher.py:149}} INFO -     suggestions = [
[2022-11-15 01:00:45,182] {{pod_launcher.py:149}} INFO -   File "quicksuggest2bq/main.py", line 78, in download_suggestions
[2022-11-15 01:00:45,182] {{pod_launcher.py:149}} INFO -     yield KintoSuggestion(**suggestion_data)
[2022-11-15 01:00:45,182] {{pod_launcher.py:149}} INFO - TypeError: __init__() got an unexpected keyword argument 'full_keywords'

Comment 5

[Frank Bertsch [:frank]]

Successfully ran today. Closing this out