Closed Bug 1584192 Opened 2 months ago Closed 27 days ago

Fix handling of multiple runs/repeats in wptreport files


(Testing :: web-platform-tests, defect)

Version 3
Not set


(firefox71 fixed)

Tracking Status
firefox71 --- fixed


(Reporter: jgraham, Assigned: jgraham)



(3 files)

Currently using --repeat produces broken wptreport files and using --rerun produces incomplete data about each iteration. Fixing these should allow us to update intermittents from a single task that uses either --repeat or --rerun or both.

Previously this would have ended up with multiple JSON objects all put
on the same line and we'd be unable to update from such
metadata. Ensure that there's one line per JSON object and the update
code is able to consume this format.

Previously when running with --rerun=N we added all the subtest results
to the previous test results and so got all N iterations of each
subtest result, but only one of each test result. Instead ensure that
top-level tests are added each time they are run, allowing multiple
test results.

The priority flag is not set for this bug.
:jgraham, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(james)
Pushed by
Fix handling multiple repeats in wptreport logs, r=maja_zf
Created web-platform-tests PR for changes under testing/web-platform/tests
Can't merge web-platform-tests PR due to failing upstream checks:
Github PR
* Taskcluster (pull_request) (


Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.
Flags: needinfo?(james)
Closed: 27 days ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla71
Pushed by
Allow handling multiple reruns in wptreport.json files, r=maja_zf
Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.
Upstream PR merged by moz-wptsync-bot
You need to log in before you can comment on or make changes to this bug.