Closed Bug 1545862 Opened 6 months ago Closed 5 months ago

Support worker-type aliases by-rootUrl

Categories

(Firefox Build System :: Task Configuration, task, P2)

Tracking

(firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox68 --- fixed

People

(Reporter: dustin, Assigned: dustin)

References

Details

Attachments

(2 files, 1 obsolete file)

To transition to a staging deployment, and later to a new production deployment, of Taskcluster, we'll need to be able to generate different workerType configurations per deployment (since we don't want to be stuck with the name "aws-provisioner-v1" when we're not, in fact, using aws-provisioner).

I think the easiest may be to add a by-rootUrl keyed-by option to this evaluation.

Note to self: we'll want this in ci-admin/ci-configuration, too -- enough that the cron and hg hook templates can use the proper provisionerId / workerType.

Priority: -- → P2

Depends on D29129

Attachment #9061356 - Attachment is obsolete: true
Pushed by dmitchell@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/29e91bd3091d
refactor to generalize worker-type aliasing r=tomprince
https://hg.mozilla.org/integration/autoland/rev/0d390c4c20d6
translate aws-provisioner-v1 to ec2 except for existing deployment r=tomprince

Backed out 2 changesets (Bug 1545862) for geko decision bustage

Push with failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&fromchange=f60b2e760d1adf5be0aae2485ab685dc8b2fb039&tochange=8887ea101536a4c3eb09cb5fbf2b04ff9dc9fc8e&selectedJob=246617300

Backout link: https://hg.mozilla.org/integration/autoland/rev/8887ea101536a4c3eb09cb5fbf2b04ff9dc9fc8e

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=246617300&repo=autoland&lineNumber=7202

[task 2019-05-15T15:34:59.730Z] * time: 2019-05-15T15:34:59.726Z
[task 2019-05-15T15:34:59.784Z] task.dependencies references non-existing tasks:
[task 2019-05-15T15:34:59.784Z] * EScg7M95THi6RwPu__ssJg
[task 2019-05-15T15:34:59.784Z] All taskIds in task.dependencies must exist
[task 2019-05-15T15:34:59.784Z] before the task is created.
[task 2019-05-15T15:34:59.784Z]
[task 2019-05-15T15:34:59.784Z]
[task 2019-05-15T15:34:59.784Z] ---
[task 2019-05-15T15:34:59.784Z]
[task 2019-05-15T15:34:59.784Z] * method: createTask
[task 2019-05-15T15:34:59.784Z] * errorCode: InputError
[task 2019-05-15T15:34:59.784Z] * statusCode: 400
[task 2019-05-15T15:34:59.784Z] * time: 2019-05-15T15:34:59.781Z
[task 2019-05-15T15:35:00.328Z] Traceback (most recent call last):
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/taskcluster/mach_commands.py", line 203, in taskgraph_decision
[task 2019-05-15T15:35:00.328Z] return taskgraph.decision.taskgraph_decision(options)
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/decision.py", line 195, in taskgraph_decision
[task 2019-05-15T15:35:00.328Z] create_tasks(tgg.graph_config, tgg.morphed_task_graph, tgg.label_to_taskid, tgg.parameters)
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/create.py", line 107, in create_tasks
[task 2019-05-15T15:35:00.328Z] f.result()
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/third_party/python/futures/concurrent/futures/_base.py", line 398, in result
[task 2019-05-15T15:35:00.328Z] return self.__get_result()
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/third_party/python/futures/concurrent/futures/thread.py", line 55, in run
[task 2019-05-15T15:35:00.328Z] result = self.fn(*self.args, **self.kwargs)
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/create.py", line 133, in create_task
[task 2019-05-15T15:35:00.328Z] res.raise_for_status()
[task 2019-05-15T15:35:00.328Z] File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/models.py", line 840, in raise_for_status
[task 2019-05-15T15:35:00.334Z] raise HTTPError(http_error_msg, response=self)
[task 2019-05-15T15:35:00.334Z] HTTPError: 403 Client Error: Forbidden for url: http://taskcluster/queue/v1/task/Slv8WK9FSEWhMLo3hv4BkA
[taskcluster 2019-05-15 15:35:01.125Z] === Task Finished ===
[taskcluster 2019-05-15 15:35:10.349Z] Unsuccessful task run with exit code: 1 completed in 89.941 seconds

Flags: needinfo?(dustin)

Hmm, something changed in the {level} substitution and this level-3 push is trying to use level-1 workers.

Flags: needinfo?(dustin)
Pushed by dmitchell@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/77efc33e0c39
refactor to generalize worker-type aliasing r=tomprince
https://hg.mozilla.org/integration/autoland/rev/23d241c96665
translate aws-provisioner-v1 to ec2 except for existing deployment r=tomprince
Status: NEW → RESOLVED
Closed: 5 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
You need to log in before you can comment on or make changes to this bug.