1990635 - Make it possible to only see the high level SP3 sub tests

Status: NEW

(Testing :: PerfCompare, enhancement, P3)

Description

[Jeff Muizelaar [:jrmuizel]]

If you go to https://perf.compare/subtests-compare-results?baseRev=208f8bc210169f0469cce2e78685205c364d9fb5&baseRepo=autoland&newRev=1f0c30406458f15af735d59093744719efb4b114&newRepo=autoland&framework=13&baseParentSignature=5257392&newParentSignature=5257392

You'll see a bunch of different things like: TodoMVC-Lit-Complex-DOM/CompletingAllItems/Async. These different pieces make up a hierarchy but there's no easy way to navigate the hierarchy.

As a user I'd like to be able to only see the TodoMVC-Lit-Complex-DOM/total etc. measurements and only then dig into an individual test to see what parts of it might have changed.

Without this is, it's quite painful for a user to dig into a performance alert and easily know which parts are most important.

This came up in bug 1987978 where I was trying to understand an SP3 regression.

Comment 1

[Greg Mierzwinski [:sparky]]

Just want to note that this is probably best handled on the perfcompare side using the subtest names with some standard on how the sub-subtests are named so they can be split. We could also add a field to the perfherder data to denote when a subtest is a part of a sub-subtest grouping.