Ingest error summary logs from taskcluster.

RESOLVED FIXED

Status

Tree Management
Treeherder: Data Ingestion
RESOLVED FIXED
a year ago
a year ago

People

(Reporter: jgraham, Assigned: jgraham)

Tracking

Details

Attachments

(1 attachment)

(Assignee)

Description

a year ago
In order for autoclassification to work on task cluster builds we need to ingest the error summary files. These are logs, but due to general weirdness aren't put in the log property but in the jobInfo property.

Comment 1

a year ago
Created attachment 8779807 [details] [review]
[treeherder] mozilla:taskcluster_process_error_summary > mozilla:master
(Assignee)

Updated

a year ago
Attachment #8779807 - Flags: review?(cdawson)
Do we have a bug for the underlying issue in taskcluster, if it's not actually fixed?
James, I agree with Will.  Is there any reason TaskCluster can't add these as real log references now?  Maybe opening a bug against them would be good.
(Assignee)

Comment 4

a year ago
They weren't real log references in buildbot either. It might be fixable in TC, but at least in buildbot "logs" were things written to stdout/stderr whereas this is a file that gets written by the test harness, moved to the blobber upload directory and then uploaded (along with a variety of things that aren't logs from the treeherder point of view). So I think that it would look just as much like a special case in TC as it does in TH.

Not that I'm opposed to them making the change of course, but I think we should land this in the meantime and then decide if there's a more elegant solution.
Comment on attachment 8779807 [details] [review]
[treeherder] mozilla:taskcluster_process_error_summary > mozilla:master

SGTM - Thanks for making that change.  This also LGTM.  ;)
Attachment #8779807 - Flags: review?(cdawson) → review+

Comment 6

a year ago
Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/11efee346b81b67d517178c12062722a2203fd08
Bug 1294149 - Process errorsummary logs from TaskCluster submissions. (#1777)

errorsummary logs containing failure lines are, for historical reasons,
not supplied as normal logs, but are in the jobInfo property of TC
submissions. Therefore in order to be processed as for buildbot we need
to extract this data from there and add it to the other log data.

Updated

a year ago
Assignee: nobody → james
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.