1291523 - Source tarball builder failed in Firefox 49.0b1

Status: RESOLVED FIXED

(Release Engineering :: Release Automation: Other, defect)

Description

[Rail Aliiev [:rail]]

See https://tools.taskcluster.net/task-inspector/#Z_gRuOqZToeGJQ8jp9lqeg

00:12:07     INFO - ##### Running clone-tools step.
00:12:07     INFO - #####
00:12:07     INFO - Running pre-action listener: influxdb_recording_pre_action
00:12:07     INFO - Running main action method: clone_tools
00:12:07     INFO - retry: Calling _get_revision with args: (<mozharness.base.vcs.mercurial.MercurialVCS object at 0x7fc8ff5b4090>, '/home/worker/workspace/build/tools'), kwargs: {}, attempt #1
00:12:07  WARNING - did not specify revision or branch; assuming "default"
00:12:07     INFO - rmtree: /home/worker/workspace/build/tools
00:12:07     INFO - retry: Calling rmtree with args: ('/home/worker/workspace/build/tools',), kwargs: {}, attempt #1
00:12:07     INFO - retry: attempt #1 caught exception: vcs share base not defined; refusing to operate sub-optimally
00:12:07     INFO - retry: Failed, sleeping 60 seconds before retrying
00:13:07     INFO - retry: Calling _get_revision with args: (<mozharness.base.vcs.mercurial.MercurialVCS object at 0x7fc8ff5b4090>, '/home/worker/workspace/build/tools'), kwargs: {}, attempt #2
00:13:07  WARNING - did not specify revision or branch; assuming "default"
00:13:07     INFO - rmtree: /home/worker/workspace/build/tools
00:13:07    DEBUG - /home/worker/workspace/build/tools doesn't exist.
00:13:07     INFO - retry: attempt #2 caught exception: vcs share base not defined; refusing to operate sub-optimally
00:13:07     INFO - retry: Failed, sleeping 120 seconds before retrying
00:15:07     INFO - retry: Calling _get_revision with args: (<mozharness.base.vcs.mercurial.MercurialVCS object at 0x7fc8ff5b4090>, '/home/worker/workspace/build/tools'), kwargs: {}, attempt #3
00:15:07  WARNING - did not specify revision or branch; assuming "default"
00:15:07     INFO - rmtree: /home/worker/workspace/build/tools
00:15:07    DEBUG - /home/worker/workspace/build/tools doesn't exist.
00:15:07     INFO - retry: attempt #3 caught exception: vcs share base not defined; refusing to operate sub-optimally
00:15:07     INFO - retry: Failed, sleeping 240 seconds before retrying
00:19:07     INFO - retry: Calling _get_revision with args: (<mozharness.base.vcs.mercurial.MercurialVCS object at 0x7fc8ff5b4090>, '/home/worker/workspace/build/tools'), kwargs: {}, attempt #4
00:19:07  WARNING - did not specify revision or branch; assuming "default"
00:19:07     INFO - rmtree: /home/worker/workspace/build/tools
00:19:07    DEBUG - /home/worker/workspace/build/tools doesn't exist.
00:19:07     INFO - retry: attempt #4 caught exception: vcs share base not defined; refusing to operate sub-optimally
00:19:07     INFO - retry: Failed, sleeping 300 seconds before retrying
00:24:07     INFO - retry: Calling _get_revision with args: (<mozharness.base.vcs.mercurial.MercurialVCS object at 0x7fc8ff5b4090>, '/home/worker/workspace/build/tools'), kwargs: {}, attempt #5
00:24:07  WARNING - did not specify revision or branch; assuming "default"
00:24:07     INFO - rmtree: /home/worker/workspace/build/tools
00:24:07    DEBUG - /home/worker/workspace/build/tools doesn't exist.
00:24:07     INFO - retry: attempt #5 caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Automation Error: Can't checkout https://hg.mozilla.org/build/tools!
00:24:07    FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally
00:24:07    FATAL - Running post_fatal callback...
00:24:07    ERROR - setting return code to 2 because fatal was called
00:24:07  WARNING - setting return code to 2
00:24:07    FATAL - Exiting -1

Comment 1

[Rail Aliiev [:rail]]

looks like we don't need checkout-tools anymore. The action can be disabled by passing 

"MOZHARNESS_ACTIONS": "no-checkout-sources no-clone-tools" as a part or task.payload.env or by disabling the action in https://dxr.mozilla.org/mozilla-beta/source/testing/mozharness/configs/builds/releng_sub_linux_configs/64_source.py#2 and probably deleting the action if it's not used.

I'd got with the following plan:

1) patch releasetasks to pass "MOZHARNESS_ACTIONS": "no-checkout-sources no-clone-tools no-setup-mock"
2) investigate if they are required for esr/release
3) investigate if we still need those actions and disable or delete them, maybe per branch
4) remove the work around in 1)

Comment 2

[Rail Aliiev [:rail]]

Attachment: PR

https://tools.taskcluster.net/task-inspector/#DbsVTxVGTu-aEw-AUtYaMQ/ (with a typo, which is not important)

Comment 3

[Rail Aliiev [:rail]]

https://tools.taskcluster.net/task-inspector/#RQBhNZXkS3md7NbRTVvqPA/ is green \o/

Comment 4

[Rail Aliiev [:rail]]

tried to run the same thing against esr45 https://tools.taskcluster.net/task-inspector/#Zn5BT412TZ60w-0Zi81Z3A and it looks good.

Comment 5

[Rail Aliiev [:rail]]

I think we are ok here