2015029 - Aggregate the manifest run times

Status: RESOLVED FIXED

(Testing :: General, task)

Description

[Florian Quèze [:florian]]

To ensure test job chunks are even, we need timing information about manifests. Most test jobs already produce errorsummary.log files that contain this information. We should fetch it periodically to make it easily available in an aggregated format.

Comment 1

[Florian Quèze [:florian]]

Attachment: Bug 2015029 - Add a fetch-manifest-data.js script to produce JSON files containing manifest runtime information, r=ahal.

Comment 2

[Florian Quèze [:florian]]

Attachment: Bug 2015029 - add a manifest-timings-daily task, r=ahal.

Comment 3

[Florian Quèze [:florian]]

Attachment: Bug 2015029 - make xpcshell and mochitest output group_result status=SKIP lines in the error summary file for missing test manifests, r=ahal.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/b82fc4432b4a
https://hg.mozilla.org/integration/autoland/rev/2ec4b449e311
make xpcshell and mochitest output group_result status=SKIP lines in the error summary file for missing test manifests, r=ahal.

Comment 5

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/57629 for changes under testing/web-platform/tests

Comment 6

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/2ec4b449e311

Comment 7

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/f1f8c7e949f0
https://hg.mozilla.org/integration/autoland/rev/afc0a24bd5a7
Add a fetch-manifest-data.js script to produce JSON files containing manifest runtime information, r=ahal,frontend-codestyle-reviewers.
https://github.com/mozilla-firefox/firefox/commit/5e0c4a5b4282
https://hg.mozilla.org/integration/autoland/rev/1364ba66ab8c
add a manifest-timings-daily task, r=ahal,taskgraph-reviewers.

Comment 9

[amarc]

https://hg.mozilla.org/mozilla-central/rev/afc0a24bd5a7
https://hg.mozilla.org/mozilla-central/rev/1364ba66ab8c