1249704 - Scheduling graph is failing with "Errors found in task nodes"

Status: RESOLVED INCOMPLETE

(Taskcluster :: General, defect)

Description

[Armen [:armenzg]]

I'm trying to schedule this graph (which validates):
https://pastebin.mozilla.org/8860375

Unfortunately, I get a traceback [1] w/o information of what is the actual issue.
The code is called from the TC client [2] which grabs from data from data.get('message') (line 431).
The actual error is sent from the scheduler code [3]

jonasfj: could you please help me figure out why? and what code changes would improve determining it from the exception raised?

[1] 
Traceback (most recent call last):
  File "/home/armenzg/repos/ci_tools/mozci/sources/tc.py", line 216, in retrigger_task
    results = schedule_graph(task_graph)
  File "/home/armenzg/repos/ci_tools/mozci/sources/tc.py", line 258, in schedule_graph
    result = scheduler.createTaskGraph(task_graph_id, task_graph)
  File "/home/armenzg/repos/taskcluster/taskcluster-client.py/taskcluster/client.py", line 481, in apiCall
    return self._makeApiCall(e, *args, **kwargs)
  File "/home/armenzg/repos/taskcluster/taskcluster-client.py/taskcluster/client.py", line 248, in _makeApiCall
    return self._makeHttpRequest(entry['method'], route, payload)
  File "/home/armenzg/repos/taskcluster/taskcluster-client.py/taskcluster/client.py", line 450, in _makeHttpRequest
    superExc=rerr
TaskclusterRestFailure: Errors found in task nodes
[2]
https://github.com/taskcluster/taskcluster-client.py/blob/master/taskcluster/client.py#L417
[3]
https://github.com/taskcluster/task-graph-scheduler/blob/832d96a9529bcc59fe41efc3160c98e9f80b572b/scheduler/helpers.js#L138

Comment 1

[Jonas Finnemann Jensen (:jonasfj)]

The `TaskclusterRestFailure` error object should carry the json body that was returned...
The json body should contain information...

See: https://github.com/taskcluster/taskcluster-client.py/blob/master/taskcluster/client.py#L448

That property should tell you the errors from:
https://github.com/taskcluster/task-graph-scheduler/blob/832d96a9529bcc59fe41efc3160c98e9f80b572b/scheduler/helpers.js#L141
As sent here:
https://github.com/taskcluster/task-graph-scheduler/blob/832d96a9529bcc59fe41efc3160c98e9f80b572b/routes/api/v1.js#L164

So basically catch the exception and dump the body property... Or even better improve taskcluster-client.py to include the body in the exception message...

Comment 2

[Selena Deckelmann :selenamarie :selena]

Armen -- Do you need more assistance with this issue, or is this resolved at this point?

Comment 3

[Armen [:armenzg]]

The code has changed too much since this got filed.