Closed Bug 1663726 Opened 4 years ago Closed 4 years ago

secret not found errors reporting in Taskcluster jobs

Categories

(Release Engineering :: Firefox-CI Administration, defect)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: mtabara, Unassigned)

Details

A Taskcluster migration happened earlier today around 16:45-17:10 UTC. There seem to have been some issues related to that as possible side-effects.

[task 2020-09-08T17:13:39.591Z]   File "/usr/local/lib/python2.7/dist-packages/taskcluster/client.py", line 270, in _makeApiCall
[task 2020-09-08T17:13:39.591Z]     response = self._makeHttpRequest(entry['method'], _route, payload)
[task 2020-09-08T17:13:39.591Z]   File "/usr/local/lib/python2.7/dist-packages/taskcluster/client.py", line 542, in _makeHttpRequest
[task 2020-09-08T17:13:39.591Z]     superExc=None
[task 2020-09-08T17:13:39.591Z] taskcluster.exceptions.TaskclusterRestFailure: Secret not found

This bug is to track that.

As tasks will recover and will need rerunning, there's a couple ways of doing that:

  1. using the UI to rerun per task
  2. using automation for larger graphs that have a lot of failing tasks.

For 2) I've put together a quick gist for what we use in RelEng to action tasks in bulk. If anyone with rerunning scopes wants to rerun stuff, feel free to use that.

The fix has landed, we're slowly recovering from this as it seems, closing the bug.
Feel free to re-open if you see any other ocurrences.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.