1515230 - Work around slow cloud-mirror.taskcluster.net for triggering actions on buildbot-master01

Status: RESOLVED FIXED

(Release Engineering :: Release Automation: Other, enhancement)

Description

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [tools] Increase timeout to 60 seconds

eg for triggering respins of partner repacks the code will attempt to retrieve an artifact like
 https://queue.taskcluster.net/v1/task/AhRzGGkrQ1yNq1YaomBESg/artifacts/public/parameters.yml
which redirects to 
 https://cloud-mirror.taskcluster.net/v1/redirect/s3/us-east-1/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Ftaskcluster-public-artifacts%2FAhRzGGkrQ1yNq1YaomBESg%2F0%2Fpublic%2Fparameters.yml
and that takes ~28s to give a redirect to
 https://s3-us-west-2.amazonaws.com/taskcluster-public-artifacts/AhRzGGkrQ1yNq1YaomBESg/0/public/parameters.yml

We have a 5 second timeout configured so give up and retry, only to exhaust all the retries.

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

I've also mentioned the slowness in #taskcluster. It might be something like a long-running dyno which is hitting memory exhaustion.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

https://hg.mozilla.org/build/tools/rev/4c437eb11fd1b2fde3e5f770f8fca626792d0b3e

Updated bm01:/builds/releaserunner3/tools from 98d1e5b4035a to that.