Present videos captured for visual metrics in comparison tool
Categories
(Testing :: Performance, task, P3)
Tracking
(Not tracked)
People
(Reporter: kimberlythegeek, Unassigned)
References
(Blocks 1 open bug)
Details
copied from https://mozilla-hub.atlassian.net/browse/FXP-1737
We capture videos for calculating visual metrics, however these are currently hard to find. We should explore ways we can present these videos to users of Treeherder, Perfherder, and engineers working on performance. Some ideas are listed below:
Fixing the side-by-side to be able to generate a comparison even when there are retriggers of the test to analyze
I would look into the possibility to convert to an animated gif to be embedded. (https://pythonprogramming.altervista.org/how-to-transform-an-mp4-to-gif-with-python-and-ffmpeg-ffmpy-module/)
Provide mozperftest command to generate a side-by-side comparison video.
I would integrate it into taskcluster (add to treeherder) actions similar to gecko-profiling, that creates the comparison on CI
Embed side-by-side videos in Perfherder compare view.
Embed videos in Perfherder alerts view.
Embed videos in Treeherder job Performance tab.
We should discuss other ways to improve and present these videos to users. I will start by creating a task within this epic to identify an initial list.
Description
•