1755306 - Airflow task adm_export.adm_weekly_aggregates_to_sftp failing on 2022-02-13

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect, P1)

Description

[Jeff Klukas [:klukas] (UTC-4)]

The Airflow task adm_export.adm_weekly_aggregates_to_sftp failed on 2022-02-13.

From the logs, the query succeeds, but we then hit:

INFO - curl: (67) Authentication failure

So it looks like the connection creds for uploading to adMarketplace's SFTP server are no longer valid.

Comment 1

[Jeff Klukas [:klukas] (UTC-4)]

I looked at the adm_sftp connection in Airflow and the password field was empty. I have access to the password from initially setting this up, so I input the password again and saved the connection. The job still failed. I looked at the connection again, and the password field again looked empty. So it may just be part of Airflow's UI that it doesn't show password values in the UI.

The container log shows:

                                  {'name': 'SFTP_PASSWORD',
                                   'value': '***',
                                   'value_from': None},

But I don't know if the *** indicates there's actually a value set or not.

Comment 2

[Jeff Klukas [:klukas] (UTC-4)]

When I try to log in via sftp on the command line, I get a password prompt and then:

Permission denied, please try again.

So it looks like the password has changed. I will coordinate with Nan.

Comment 3

[Jeff Klukas [:klukas] (UTC-4)]

Nan confirmed that the password changed. We now have the new password uploaded to WTMO and the task finished successfully.