1680239 - if we have a hang in pre-test setup, we wait for task expiration (90 minutes)

Status: NEW

(Testing :: General, enhancement)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

I would like to find a way to make our pre-task have a timeout of 5 minutes and throw an exception to terminate the task if found. This is found in:
https://bugzilla.mozilla.org/show_bug.cgi?id=1589796#c233

The code where we have this problem is:
https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/testbase.py#730

I assume we would need to call run_command with output_timeout=300

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

This call appears to only be made by pre/post setup commands from task wrapper; When I add output_timeout as a param to run_command it runs it via ProcessHandler instead of subprocess.popen which fails to find files. If I run it as shell=True things work. I want to test at larger scale and determine if there are hidden failures which are not easy to see locally and on simple try pushes.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1680239 - force timeout on preflight setup commands

force a timeout on preflight/postflight setup commands