1375905 - unable to backfill taskcluster jobs due to treeherder api changes

Status: RESOLVED DUPLICATE of bug 1373043

(Taskcluster :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

I tried to backfill some unittests today and the action tasks failed:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=401475243963bfed2855822f396c6d7f6ba20c19&selectedJob=109569486

and a log:
https://public-artifacts.taskcluster.net/cG5rdE52SfK42HUuwuXu7Q/0/public/logs/live_backing.log

In the log I see this:
[task 2017-06-23T14:32:26.443332Z] Traceback (most recent call last):
[task 2017-06-23T14:32:26.443397Z]   File "/home/worker/checkouts/gecko/taskcluster/mach_commands.py", line 239, in taskgraph_backfill
[task 2017-06-23T14:32:26.443425Z]     return taskgraph.action.backfill(options['project'], options['job_id'])
[task 2017-06-23T14:32:26.443449Z]   File "/home/worker/checkouts/gecko/taskcluster/taskgraph/action.py", line 95, in backfill
[task 2017-06-23T14:32:26.443470Z]     for decision in load_decisions(s, project, resultsets, filters):
[task 2017-06-23T14:32:26.443502Z]   File "/home/worker/checkouts/gecko/taskcluster/taskgraph/action.py", line 145, in load_decisions
[task 2017-06-23T14:32:26.443541Z]     inspect = [detail["url"] for detail in details if detail["value"] == "Inspect Task"][0]
[task 2017-06-23T14:32:26.443558Z] IndexError: list index out of range

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

according to :bstack on irc this is failing due to a change in the treeherder API.

Comment 2

[Ed Morley [:emorley]]

This was fixed on June 14th, the same day the try push was from.

Comment 3

[Ed Morley [:emorley]]

(So an mozilla-central checkout from after the 14th June will work)

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

unfortunately I was trying to figure out on inbound where a root cause of a failure was on June 14th- glad to know this is fixed going forward.

Comment 5

[Ed Morley [:emorley]]

To clarify, this isn't a change on Treeherder's API, it was an interntional change in the data Taskcluster submitted to Treeherder (such that the API then had nothing to return) - bug 1328947.

Comment 6

[Greg Arndt [:garndt]]

Right, this was not on the TH side.

In hindsight, the changes should have been:
1. update in-tree scheduling to support a world without that data stored in TH
2. wait a period of time (maybe 1 month)
3. remove links from the job data submitted to Treeherder from Taskcluster

The part that was not realized at the time is that pushes prior to the fix to in-tree backfilling support would be broken.