938745 - Upload raw structured xpcshell logs to blobber

Status: RESOLVED FIXED

(Testing :: XPCShell Harness, defect)

Description

[Andrew Halberstadt [:ahal]]

Right now the xpcshell harness supports structured logging, but the only thing we do with it is convert it back into unstructured format. I think blobber is finished now, so we should at least have the slaves upload the unstructured versions there for mass consumption.

We should also add links to it in the normal logs and tbpl ui for convenience.

Comment 1

[Andrew Halberstadt [:ahal]]

From irc:
<ahal> catlee-away: is blobber ready for mass use?
<ahal> and is there documentation somewhere on how to use it?
<catlee-away> ahal: write files into $MOZ_UPLOAD_DIR if it exists
<catlee-away> done
<ahal> catlee-away: nice.. how do I get a url for it?
<catlee-away> all the files are uploaded at the end, and urls for each file printed in the log for now

Comment 2

[Gregory Szorc [:gps]]

A alternative and/or supplement is to write a concise machine readable file (probably JSON) of the high-level test results (e.g. list of test files that ran and their result). That's probably more manageable than the low-level structured log "stream." Once that's in place, TBPL and other downstream consumers can start using that file and the text log becomes irrelevant to machines and we can focus on tailoring stdout for humans.

Comment 3

[Andrew Halberstadt [:ahal]]

I don't really care whether the test result processing happens in the xpcshell harness pre-upload or by consumers post upload, as long as we also upload the raw logs and the processing logic lives in an easily accessible library (I'd vote for mozresults :p).

Comment 4

[Chris Manchester (limited bugmail, email directly)]

Attachment: Add command line args to in-tree config to upload raw logs to blobber.

A patch to do this when the time comes.

Comment 5

[Chris Manchester (limited bugmail, email directly)]

Comment on attachment 8488840 [details] [diff] [review]
Add command line args to in-tree config to upload raw logs to blobber.

This is bitrotted. I'll upload a new patch when I'm reasonably convinced bug 1033126 isn't going to bounce.

Comment 6

[Chris Manchester (limited bugmail, email directly)]

Attachment: MozReview Request: bz://938745/chmanchester

Comment 7

[Chris Manchester (limited bugmail, email directly)]

/r/139 - Bug 938745 - Add command line args to in-tree config to upload raw logs to blobber.;r=ahal

Pull down this commit:

hg pull review -r 95c9cf10a3152257be8d3725d09b381238440bf6

Comment 8

[Chris Manchester (limited bugmail, email directly)]

/r/139 - Bug 938745 - Add command line args to in-tree config to upload raw logs to blobber.;r=ahal

Pull down this commit:

hg pull review -r 95c9cf10a3152257be8d3725d09b381238440bf6

Comment 9

[Chris Manchester (limited bugmail, email directly)]

/r/139 - Bug 938745 - Add command line args to in-tree config to upload raw logs to blobber.;r=ahal

Pull down this commit:

hg pull review -r 95c9cf10a3152257be8d3725d09b381238440bf6

Comment 10

[Chris Manchester (limited bugmail, email directly)]

https://treeherder.mozilla.org/ui/#/jobs?repo=try&revision=1a35ea8c336c

Comment 11

[Andrew Halberstadt [:ahal]]

https://reviewboard.mozilla.org/r/137/#review67

Ship It!

Comment 12

[Chris Manchester (limited bugmail, email directly)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/8b9fa04a648c

Comment 13

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/8b9fa04a648c

Comment 15

[Chris Manchester (limited bugmail, email directly)]

Attachment: MozReview Request: Bug 938745 - Add command line args to in-tree config to upload raw logs to blobber.;r=ahal