1724140 - Show the graph with runs for before/after at the same time

Status: RESOLVED WONTFIX

(Tree Management :: Perfherder, enhancement, P4)

Description

[Tooru Fujisawa [:arai]]

Attachment: perfherder.png

Steps to reproduce:

1. open perfherder page, comparing 2 revisions with multiple runs
   • https://treeherder.mozilla.org/perfherder/compare?originalProject=try&originalRevision=a9d0ae42ce3ae907c83936a8837caf06908bac81&newProject=try&newRevision=846d8787a88518999298cee6ca0b73ba8f34bc5f&framework=13&page=2&showOnlyComparable=1
2. hover over the average score for before/after

Actual result:

the graph with runs for before/after are shown separately
("Current" in the attachment)

Expected result:

The graph with runs for before/after are shown at the same time, (Proposal (A) in the attachment),
so that it's easier to compare the result with bi-modal/multi-modal behavior.

Optionally show a histogram (Proposal (B) in the attachment),
so that it's easier to see the peak shift visually.

Comment 1

[Tooru Fujisawa [:arai]]

example graph using actual data, in https://bug531915.bmoattachments.org/attachment.cgi?id=9234186

Comment 2

[Alexandru Irimovici]

Thanks arai for the detailed suggestion. This is a really helpful enhancement for the Compare View. We'll add this task to the next grooming and planning sessions for the perfteam

Comment 3

[Acasandrei Beatrice (needinfo me)]

Jira ticket: https://mozilla-hub.atlassian.net/browse/FXP-1698

Comment 4

[Tooru Fujisawa [:arai]]

Attachment: show graph inside table

another example that shows the graph in the table, instead of balloon

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

This has been implemented in PerfCompare.