1899995 - Investigate why performance regressions are not detected on Android

Status: NEW

(Core :: Performance Engineering, task)

Description

[Alessio Placitelli [:Dexter]]

A severe performance regression got recently uncovered (see bug 1898810): the regression is not new, but had recently gotten worse which triggered individuals to manually investigate.

This bug is for investigating why this regression wasn't discovered as soon as the affected code was landed, when switching the rkv backend to "safe mode" (~2022).

Running notes are being captured in this doc

Comment 1

[Andrew Creskey [:acreskey]]

Similarly, I'd like to see if our performance alerts pick up on the improvements landed in bug 1892230, bug 1898515, and bug 1898649.
We know from bug 1899169 that these changes lead to significant improvements in CI tests. (high-confidence improvements via perf compare).