1556488 - request to 'Trigger all Talos jobs' fails with: HTTPError: 403 Client Error: Forbidden for url: http://taskcluster/queue/v1/task/...

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Go to https://treeherder.mozilla.org/#/jobs?repo=try&revision=9d34683cc3f1f5d514093200cd9ae3bac1e616c1&selectedJob=249752449
From the push menu at the top right, request 'Trigger all Talos jobs', choose the default (6) and submit.

Actual result: The Action raT job fails with:
[task 2019-06-03T14:42:54.521Z] Creating task with taskId fsm0P9jFQrWDzfZYEvwUCA for test-windows10-64-shippable-qr/opt-talos-bcv-e10s
[task 2019-06-03T14:42:54.522Z] Creating task with taskId BIbjn3chRw-J8aeFknAYUg for test-macosx1014-64-shippable/opt-talos-svgr-fis-e10s
[task 2019-06-03T14:42:55.676Z] Traceback (most recent call last):
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/taskcluster/mach_commands.py", line 272, in action_callback
[task 2019-06-03T14:42:55.676Z] test=False)
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/actions/registry.py", line 324, in trigger_action_callback
[task 2019-06-03T14:42:55.676Z] cb(Parameters(**parameters), graph_config, input, task_group_id, task_id)
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/actions/add_talos.py", line 56, in add_all_talos
[task 2019-06-03T14:42:55.676Z] decision_task_id,
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/actions/util.py", line 167, in create_tasks
[task 2019-06-03T14:42:55.676Z] decision_task_id,
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/create.py", line 107, in create_tasks
[task 2019-06-03T14:42:55.676Z] f.result()
[task 2019-06-03T14:42:55.676Z] File "/builds/worker/checkouts/gecko/third_party/python/futures/concurrent/futures/_base.py", line 398, in result
[task 2019-06-03T14:42:55.677Z] return self.__get_result()
[task 2019-06-03T14:42:55.677Z] File "/builds/worker/checkouts/gecko/third_party/python/futures/concurrent/futures/thread.py", line 55, in run
[task 2019-06-03T14:42:55.677Z] result = self.fn(*self.args, **self.kwargs)
[task 2019-06-03T14:42:55.677Z] File "/builds/worker/checkouts/gecko/taskcluster/taskgraph/create.py", line 133, in create_task
[task 2019-06-03T14:42:55.677Z] res.raise_for_status()
[task 2019-06-03T14:42:55.677Z] File "/builds/worker/checkouts/gecko/third_party/python/requests/requests/models.py", line 840, in raise_for_status
[task 2019-06-03T14:42:55.677Z] raise HTTPError(http_error_msg, response=self)
[task 2019-06-03T14:42:55.677Z] HTTPError: 403 Client Error: Forbidden for url: http://taskcluster/queue/v1/task/AN8tWsHyQsmTQ8GEiZXDhg
[taskcluster 2019-06-03 14:42:56.425Z] === Task Finished ===
[taskcluster 2019-06-03 14:42:59.077Z] Unsuccessful task run with exit code: 1 completed in 102.068 seconds

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Edwin, please take a look at this:

[task 2019-06-03T17:27:55.249Z] Creating task with taskId NmffyADhQTG3G-AXGDfCDQ for test-windows10-64-shippable/opt-talos-g5-fis-e10s
[task 2019-06-03T17:27:55.250Z] Client ID task-client/UKBLd475S_OHJilGaxf6lg/0/on/us-east-1/i-0fa8a2b85aa8e7afc/until/1559584029.117 does not have sufficient scopes and is missing the following scopes:
[task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z] [task 2019-06-03T17:27:55.250Z] generic-worker:os-group:bitbar/gecko-t-win64-aarch64-laptop/Administrators [task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z] This request requires the client to satisfy the following scope expression:
[task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z] [task 2019-06-03T17:27:55.250Z] { [task 2019-06-03T17:27:55.250Z] "AllOf": [ [task 2019-06-03T17:27:55.250Z] "generic-worker:os-group:bitbar/gecko-t-win64-aarch64-laptop/Administrators", [task 2019-06-03T17:27:55.250Z] "queue:route:tc-treeherder.v2.try.9d34683cc3f1f5d514093200cd9ae3bac1e616c1.369202", [task 2019-06-03T17:27:55.250Z] { [task 2019-06-03T17:27:55.250Z] "AnyOf": [ [task 2019-06-03T17:27:55.250Z] { [task 2019-06-03T17:27:55.250Z] "AllOf": [ [task 2019-06-03T17:27:55.250Z] "queue:scheduler-id:gecko-level-1", [task 2019-06-03T17:27:55.250Z] { [task 2019-06-03T17:27:55.250Z] "AnyOf": [ [task 2019-06-03T17:27:55.250Z] "queue:create-task:highest:bitbar/gecko-t-win64-aarch64-laptop", [task 2019-06-03T17:27:55.250Z] "queue:create-task:very-high:bitbar/gecko-t-win64-aarch64-laptop", [task 2019-06-03T17:27:55.250Z] "queue:create-task:high:bitbar/gecko-t-win64-aarch64-laptop", [task 2019-06-03T17:27:55.250Z] "queue:create-task:medium:bitbar/gecko-t-win64-aarch64-laptop", [task 2019-06-03T17:27:55.250Z] "queue:create-task:low:bitbar/gecko-t-win64-aarch64-laptop", [task 2019-06-03T17:27:55.250Z] "queue:create-task:very-low:bitbar/gecko-t-win64-aarch64-laptop" [task 2019-06-03T17:27:55.250Z] ] [task 2019-06-03T17:27:55.250Z] } [task 2019-06-03T17:27:55.250Z] ] [task 2019-06-03T17:27:55.250Z] } [task 2019-06-03T17:27:55.250Z] ] [task 2019-06-03T17:27:55.250Z] } [task 2019-06-03T17:27:55.250Z] ] [task 2019-06-03T17:27:55.250Z] } [task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z] ---
[task 2019-06-03T17:27:55.250Z]
[task 2019-06-03T17:27:55.250Z] * method: createTask
[task 2019-06-03T17:27:55.250Z] * errorCode: InsufficientScopes
[task 2019-06-03T17:27:55.250Z] * statusCode: 403
[task 2019-06-03T17:27:55.250Z] * time: 2019-06-03T17:27:55.230Z

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

:aryx - wouldn't worker permission be the scope of the Taskcluster team? I have not touched anything to do with windows10-aarch64 + talos jobs personally, so this is new to me.

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

(In reply to Edwin Gao (:egao) from comment #2)

:aryx - wouldn't worker permission be the scope of the Taskcluster team? I have not touched anything to do with windows10-aarch64 + talos jobs personally, so this is new to me.

Tom, can you answer this, please?

Comment 4

[Tom Prince [:tomprince]]

Attachment: Bug 1556488: Don't try to run talos tasks that would not run on the given branch; r?dustin

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a5342d39f94f
Don't try to run talos tasks that would not run on the given branch; r=dustin

Comment 6

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/a5342d39f94f