Open Bug 1472171 Opened 3 years ago Updated 3 years ago

Upload raw structured logs as artifacts from Python unit tests

Categories

(Testing :: Python Test, enhancement)

Version 2
enhancement
Not set
normal

Tracking

(Not tracked)

ASSIGNED

People

(Reporter: davehunt, Assigned: davehunt)

Details

Attachments

(1 file)

Tests run via |mach python-test| do not currently produce and upload structured logs, and therefore results are not available in ActiveData. As we're already using mozlog's pytest plugin, we should be able to generate a raw structured log and upload the resulting file as an artifact.
Assignee: nobody → dave.hunt
Status: NEW → ASSIGNED
ahal: This is basically your patch applied with no changes, but it appears to be working. I've pushed to try, and the results look good: https://treeherder.mozilla.org/#/jobs?repo=try&revision=7a39c85f0e9180456d817c4be26f98a088222448&selectedJob=185578055

The py3 jobs are uploading empty log files, which is due to mozlog not yet supporting py3, but the result of the jobs themselves don't appear to be affected.
Comment on attachment 8988727 [details]
Bug 1472171 - Upload raw structured logs as artifacts from Python unit tests;

https://reviewboard.mozilla.org/r/253934/#review260670

I think having a single suite for the entire run should be a blocker to getting this landed. As it stands, it will cause a lot of extra variability in ActiveData (would probably double or triple the number of suite records) and might make a bunch of queries/dashboards less useful as a result. Tbh, I'm not even sure that ActiveData would pick this up automatically or not.

I also probably shouldn't review my own code :).
Attachment #8988727 - Flags: review?(ahal) → review-
You need to log in before you can comment on or make changes to this bug.