Open Bug 1316590 Opened 4 years ago Updated 9 months ago
Compare view should allow viewing subtests across all tests
I've been using Perfherder's compare view to compare build times on try pushes for my sccache2 work, it's super useful! In this case the overall build time metric is not always helpful by itself, because there are so many build steps and so much variability in them. I wind up diving into the subtests to compare just some parts, like the compile tier. One thing that could be better for my use case would be if I could see subtests across all the test types, so I could compare the 'compile' subtest across all build types. One of the specific comparsions I'm looking at is: https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=4f7d1609a34d485119d81f1b3e93bb4294fbabc1&newProject=try&newRevision=139e47cbd01b681ee39bdd1338de7d3b83c77871&framework=2&filter=buildbot&showOnlyImportant=0 You can see that the "build times opt buildbot-r3.xlarge" linux32 result shows low confidence, but clicking through to the subtests shows that the compile and configure subtests have good data with high confidence: https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=try&originalRevision=4f7d1609a34d485119d81f1b3e93bb4294fbabc1&newProject=try&newRevision=139e47cbd01b681ee39bdd1338de7d3b83c77871&originalSignature=bbdcb9c1b0ad3e0794eb156c6b2d8df9f255b7e7&newSignature=bbdcb9c1b0ad3e0794eb156c6b2d8df9f255b7e7&framework=2
possibly a simple checkbox to "show all subtests" ?
No longer blocks: 1565516
Status: NEW → RESOLVED
Closed: 10 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
You need to log in before you can comment on or make changes to this bug.