1605232 - Improve workflow when running taskcluster jobs locally

Status: ASSIGNED

(Firefox Build System :: Task Configuration, enhancement, P3)

Description

[Steve Fink [:sfink] [:s:]]

I have been experimenting with running tasks locally with mach taskcluster-load-image, and I cobbled together a workflow that is much nicer with a couple of additional options to run-task.

Comment 1

[Steve Fink [:sfink] [:s:]]

Attachment: Bug 1605232 - Add run-task --keep option to allow rerunning tasks locally without re-downloading compilers

Comment 2

[Steve Fink [:sfink] [:s:]]

Attachment: Bug 1605232 - Add run-task --existing-gecko-checkout option for running taskcluster job locally using host directory mounted into container

Comment 3

[Mike Hommey [:glandium]]

For the first one, the removal of fetches is a workaround, not a feature. See bug 1492362.

Comment 4

[Steve Fink [:sfink] [:s:]]

(In reply to Mike Hommey [:glandium] [out until Jan 7] (high latency) from comment #3)

For the first one, the removal of fetches is a workaround, not a feature. See bug 1492362.

Oh yeah, thanks for the pointer! I wasn't sure from that bug what the desired outcome is, though -- now that it appears that the source checkout is separate from the fetches dir, that's no longer a problem. But I assume something still wants to do this cleanup, to avoid having stale versions of fetches lying around? It seems like something like --keep is still desirable for local runs, and perhaps for interactive jobs if it can somehow be told that it's interactive (I'm not sure why Windows interactive jobs don't have the interactive feature set, even if they don't need or want the env var setting.)

Comment 5

[Steve Fink [:sfink] [:s:]]

I should also mention that I pointed to this bug from http://blog.mozilla.org/sfink/2019/12/20/running-taskcluster-tasks-locally/

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

The following patches are waiting for review from an inactive reviewer:

ID	Title	Author	Reviewer Status
D57876	Bug 1605232 - Add run-task --keep option to allow rerunning tasks locally without re-downloading compilers	sfink	tomprince: Inactive
D57881	Bug 1605232 - Add run-task --existing-gecko-checkout option for running taskcluster job locally using host directory mounted into container	sfink	tomprince: Inactive

:sfink, could you please find another reviewer or abandon the patch if it is no longer relevant?

For more information, please visit auto_nag documentation.