1754232 - Airflow task partybal.partybal failing on 2022-02-08

Status: RESOLVED WONTFIX

(Data Platform and Tools :: Monitoring & Alerting, defect)

Description

[Daniel Thorn [:relud]]

since 09:00 UTC with FileNotFoundError: [Errno 2] No such file or directory: '/output/index.html'

full exception:

[2022-02-08 16:50:28,758] {{pod_launcher.py:149}} INFO - + /opt/conda/envs/partybal/bin/python /app/invoke.py invoke --updated-seconds-ago 90000 --output /output
[2022-02-08 16:54:05,165] {{pod_launcher.py:149}} INFO - Traceback (most recent call last):
[2022-02-08 16:54:05,169] {{pod_launcher.py:149}} INFO -   File "/app/invoke.py", line 436, in <module>
[2022-02-08 16:54:05,169] {{pod_launcher.py:149}} INFO -     cli()
[2022-02-08 16:54:05,169] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/site-packages/click/core.py", line 1137, in __call__
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -     return self.main(*args, **kwargs)
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/site-packages/click/core.py", line 1062, in main
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -     rv = self.invoke(ctx)
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/site-packages/click/core.py", line 1668, in invoke
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -     return ctx.invoke(self.callback, **ctx.params)
[2022-02-08 16:54:05,170] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/site-packages/click/core.py", line 763, in invoke
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -     return __callback(*args, **kwargs)
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -   File "/app/invoke.py", line 407, in invoke
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -     (output / "index.html").write_text(render_index(experiments, cache))
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/pathlib.py", line 1255, in write_text
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -     with self.open(mode='w', encoding=encoding, errors=errors) as f:
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/pathlib.py", line 1222, in open
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -     return io.open(self, mode, buffering, encoding, errors, newline,
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -   File "/opt/conda/envs/partybal/lib/python3.8/pathlib.py", line 1078, in _opener
[2022-02-08 16:54:05,171] {{pod_launcher.py:149}} INFO -     return self._accessor.open(self, flags, mode)
[2022-02-08 16:54:05,172] {{pod_launcher.py:149}} INFO - FileNotFoundError: [Errno 2] No such file or directory: '/output/index.html'

Comment 1

[Anna Scholtz [:ascholtz]]

Yeah, this is kind of expected. Jetstream was delayed last night and is still running at the moment so it didn't produce any results for last night's run yet. Partybal will succeed once jetstream has completed.
I guess we could add an external dependencies to jetstream to make that clearer.

Comment 2

[Daniel Thorn [:relud]]

or a comment in the dag description, indicating that it's dependent on jetstream but can't have an explicit dependency due to mismatched timing.

Comment 3

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/telemetry-airflow/pull/1463