1806877 - add ability to generate 30 days of groupsummary data from test-info-all job

Status: RESOLVED FIXED

(Testing :: General, enhancement)

Description

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

having the ability to get more accurate runtime information related to specific tests will be useful. In treeherder we implemented a groupsummary api to provide a mapping of a group (aka a manifest) and the number of times it ran along with status and classification. While there are edge cases this should get us >80% of the way to an accurate count.

Once generated, we can use this data in:

• treeherder's intermittent failure report (daily/weekly) on each bug
• ./mach test-info ...
• output within test-info-all-tests.json which is read by searchfox, this already has failure info, having more accurate info about total runs and % failed (per config/variant) would make data actionable.
• other dashboards (like bugbug, etc.)

This will generate an artifact everytime test-info-all task is ran, this artifact will have 30 days of history which will be sorted by date so we can rotate data out.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

Attachment: Bug 1806877 - add ability to generate 30 days of groupsummary data from test-info-all job. r=ahal!

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4f1b2141ae7e
add ability to generate 30 days of groupsummary data from test-info-all job. r=ahal

Comment 3

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/4f1b2141ae7e