1881444 - 5.38% bing-search-restaurants loadtime (Android) regression on Mon February 12 2024

Status: RESOLVED FIXED

(Core :: Networking, defect)

Description

[Acasandrei Beatrice (needinfo me)]

Perfherder has detected a browsertime performance regression from push 32a53e4ded8400076c08a338c11c6038c7faebce, which was backed out as requested by Aryx. Since it was backed out there's no need to address this regression, I've filed this bug so that we can acknowledge the change summary of the alert.

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)	Performance Profiles
4%	allrecipes fcp	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	625.91 -> 649.83
4%	allrecipes FirstVisualChange	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	758.78 -> 785.97

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)	Performance Profiles
6%	booking fcp	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	184.05 -> 173.52	Before/After
5%	bing-search-restaurants loadtime	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	149.74 -> 141.68	Before/After
5%	booking largestContentfulPaint	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	204.77 -> 194.07	Before/After
5%	bing-search-restaurants loadtime	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	149.12 -> 141.58	Before/After
5%	booking FirstVisualChange	android-hw-a51-11-0-aarch64-shippable-qr	warm webrender	236.70 -> 225.88	Before/After

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests.

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask a sheriff to do that for you.

You can run these tests on try with ./mach try perf --alert 41528

For more information on performance sheriffing please see our FAQ.

Comment 1

[Valentin Gosu [:valentin] (he/him)]

Thanks. I'll do a mach try perf before landing the patch again.