1730543 - Intermittent subprocess.CalledProcessError: Command '('/usr/bin/hg', 'push-to-try', '-m', 'scriptworker tests: beetmover-candidates\n\nPushed via `mach try scriptworker`')' returned non-zero exit status 255.

Status: RESOLVED INCOMPLETE

(Release Engineering :: Release Automation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=351403382&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AZ-EXUU5QKOTD-D5uZY_eQ/runs/0/artifacts/public/logs/live_backing.log

---

A try_task_config.json
[task 2021-09-13T16:56:02.474Z] pushing to ssh://hg.mozilla.org/try
[task 2021-09-13T16:56:02.474Z] remote: Warning: Permanently added the ED25519 host key for IP address '63.245.208.203' to the list of known hosts.
[task 2021-09-13T17:06:16.079Z] searching for changes
[task 2021-09-13T17:06:16.079Z] remote: waiting for lock on working directory of /repo/hg/mozilla/try held by process '19513' on host 'hgssh1.dmz.mdc1.mozilla.com/effffffc'
[task 2021-09-13T17:06:16.079Z] remote: abort: working directory of /repo/hg/mozilla/try: timed out waiting for lock held by 'hgssh1.dmz.mdc1.mozilla.com/effffffc:23680'
[task 2021-09-13T17:06:16.079Z] temporary commit removed, repository restored
[task 2021-09-13T17:06:16.079Z] abort: stream ended unexpectedly (got 0 bytes, expected 4)
[task 2021-09-13T17:06:17.287Z] Creating local state directory: /builds/worker/workspace/srcdirs/gecko-8a5b87fe5d69
[task 2021-09-13T17:06:17.287Z] Error running mach:
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z]     ['try', 'scriptworker', '--route', '[e-mail]-failed', '--route', '[e-mail]-exception', 'beetmover-candidates']
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z] The error occurred in code that was called by the mach command. This is either
[task 2021-09-13T17:06:17.287Z] a bug in the called code itself or in the way that mach is calling it.
[task 2021-09-13T17:06:17.287Z] You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2021-09-13T17:06:17.287Z] isn't, please use |./mach busted file try| to report it. If |./mach busted| is
[task 2021-09-13T17:06:17.287Z] misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z] If filing a bug, please include the full output of mach, including this error
[task 2021-09-13T17:06:17.287Z] message.
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z] The details of the failure are as follows:
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z] subprocess.CalledProcessError: Command '('/usr/bin/hg', 'push-to-try', '-m', 'scriptworker tests: beetmover-candidates\n\nPushed via `mach try scriptworker`')' returned non-zero exit status 255.
[task 2021-09-13T17:06:17.287Z] 
[task 2021-09-13T17:06:17.287Z]   File "/builds/worker/checkouts/gecko/tools/tryselect/mach_commands.py", line 502, in try_scriptworker
[task 2021-09-13T17:06:17.287Z]     return self.run(command_context, **kwargs)
[task 2021-09-13T17:06:17.287Z]   File "/builds/worker/checkouts/gecko/tools/tryselect/mach_commands.py", line 202, in run
[task 2021-09-13T17:06:17.287Z]     return mod.run(**kwargs)
[task 2021-09-13T17:06:17.287Z]   File "/builds/worker/checkouts/gecko/tools/tryselect/selectors/scriptworker.py", line 175, in run
[task 2021-09-13T17:06:17.287Z]     files_to_change=files_to_change,
[task 2021-09-13T17:06:17.287Z]   File "/builds/worker/checkouts/gecko/tools/tryselect/push.py", line 217, in push_to_try
[task 2021-09-13T17:06:17.287Z]     vcs.push_to_try(commit_message)
[task 2021-09-13T17:06:17.287Z]   File "/builds/worker/checkouts/gecko/python/mozversioncontrol/mozversioncontrol/__init__.py", line 496, in push_to_try
[task 2021-09-13T17:06:17.287Z]     (self._tool, "push-to-try", "-m", message), cwd=self.path, env=self._env
[task 2021-09-13T17:06:17.287Z]   File "/usr/lib/python3.7/subprocess.py", line 347, in check_call
[task 2021-09-13T17:06:17.287Z]     raise CalledProcessError(retcode, cmd)
[task 2021-09-13T17:06:17.325Z] Error running mach:
[task 2021-09-13T17:06:17.325Z] 
[task 2021-09-13T17:06:17.325Z]     ['release', 'push-scriptworker-canary', '--scriptworker', 'beetmover', '--address', '[e-mail]', '--ssh-key-secret', 'project/releng/scriptworker/scriptworker-canary-sshkey']
[task 2021-09-13T17:06:17.325Z] 
[task 2021-09-13T17:06:17.326Z] The error occurred in code that was called by the mach command. This is either
a bug in the called code itself or in the way that mach is calling it.
[task 2021-09-13T17:06:17.326Z] You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2021-09-13T17:06:17.326Z] isn't, please use |./mach busted file release| to report it. If |./mach busted| is
[task 2021-09-13T17:06:17.326Z] misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2021-09-13T17:06:17.326Z] 
[task 2021-09-13T17:06:17.326Z] If filing a bug, please include the full output of mach, including this error
[task 2021-09-13T17:06:17.326Z] message.
[task 2021-09-13T17:06:17.326Z] 
[task 2021-09-13T17:06:17.326Z] The details of the failure are as follows:
[task 2021-09-13T17:06:17.326Z] 
[task 2021-09-13T17:06:17.326Z] subprocess.CalledProcessError: Command '['/builds/worker/checkouts/gecko/mach', 'try', 'scriptworker', '--route', '[e-mail]-failed', '--route', '[e-mail]-exception', 'beetmover-candidates']' returned non-zero exit status 1.
[task 2021-09-13T17:06:17.326Z] 
[task 2021-09-13T17:06:17.326Z]   File "/builds/worker/checkouts/gecko/python/mozrelease/mozrelease/mach_commands.py", line 122, in push_scriptworker_canary
[task 2021-09-13T17:06:17.326Z]     ssh_key_secret=ssh_key_secret,
[task 2021-09-13T17:06:17.326Z]   File "/builds/worker/checkouts/gecko/python/mozrelease/mozrelease/scriptworker_canary.py", line 114, in push_canary
[task 2021-09-13T17:06:17.326Z]     subprocess.check_call(base_command + [task], env=env)
[task 2021-09-13T17:06:17.326Z]   File "/usr/lib/python3.7/subprocess.py", line 347, in check_call
[task 2021-09-13T17:06:17.326Z]     raise CalledProcessError(retcode, cmd)
[taskcluster 2021-09-13 17:06:17.643Z] === Task Finished ===
[taskcluster 2021-09-13 17:06:17.643Z] Unsuccessful task run with exit code: 1 completed in 719.033 seconds

Comment 1

[Intermittent Failures Robot]

1 failures in 3375 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• firefox-release: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1730543&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.