Closed Bug 1584192 Opened 2 months ago Closed 27 days ago

Fix handling of multiple runs/repeats in wptreport files

Categories

(Testing :: web-platform-tests, defect)

Version 3
defect
Not set

Tracking

(firefox71 fixed)

RESOLVED FIXED
mozilla71
Tracking Status
firefox71 --- fixed

People

(Reporter: jgraham, Assigned: jgraham)

Details

Attachments

(3 files)

Currently using --repeat produces broken wptreport files and using --rerun produces incomplete data about each iteration. Fixing these should allow us to update intermittents from a single task that uses either --repeat or --rerun or both.

Previously this would have ended up with multiple JSON objects all put
on the same line and we'd be unable to update from such
metadata. Ensure that there's one line per JSON object and the update
code is able to consume this format.

Previously when running with --rerun=N we added all the subtest results
to the previous test results and so got all N iterations of each
subtest result, but only one of each test result. Instead ensure that
top-level tests are added each time they are run, allowing multiple
test results.

The priority flag is not set for this bug.
:jgraham, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(james)
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/83dc6a6ed931
Fix handling multiple repeats in wptreport logs, r=maja_zf
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/19697 for changes under testing/web-platform/tests
Can't merge web-platform-tests PR due to failing upstream checks:
Github PR https://github.com/web-platform-tests/wpt/pull/19697
* Taskcluster (pull_request) (https://tools.taskcluster.net/task-group-inspector/#/ILlgESoORMCH4dPp78kI_g)

DONTBUILD

Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.
Flags: needinfo?(james)
Status: NEW → RESOLVED
Closed: 27 days ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla71
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/325b5278961f
Allow handling multiple reruns in wptreport.json files, r=maja_zf
Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.
Upstream PR merged by moz-wptsync-bot
You need to log in before you can comment on or make changes to this bug.