Open Bug 1316590 Opened 3 years ago Updated Last month
Compare view should allow viewing subtests across all tests
I've been using Perfherder's compare view to compare build times on try pushes for my sccache2 work, it's super useful! In this case the overall build time metric is not always helpful by itself, because there are so many build steps and so much variability in them. I wind up diving into the subtests to compare just some parts, like the compile tier. One thing that could be better for my use case would be if I could see subtests across all the test types, so I could compare the 'compile' subtest across all build types. One of the specific comparsions I'm looking at is: https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4f7d1609a34d485119d81f1b3e93bb4294fbabc1&newProject=try&newRevision=139e47cbd01b681ee39bdd1338de7d3b83c77871&framework=2&filter=buildbot&showOnlyImportant=0 You can see that the "build times opt buildbot-r3.xlarge" linux32 result shows low confidence, but clicking through to the subtests shows that the compile and configure subtests have good data with high confidence: https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=try&originalRevision=4f7d1609a34d485119d81f1b3e93bb4294fbabc1&newProject=try&newRevision=139e47cbd01b681ee39bdd1338de7d3b83c77871&originalSignature=bbdcb9c1b0ad3e0794eb156c6b2d8df9f255b7e7&newSignature=bbdcb9c1b0ad3e0794eb156c6b2d8df9f255b7e7&framework=2
possibly a simple checkbox to "show all subtests" ?
Depends on: 1509216
Assignee: nobody → igoldan
Duplicate of this bug: 1410430
No longer blocks: 1565516
You need to log in before you can comment on or make changes to this bug.