1745474 - 196.19 - 109.92% cnn-nav.landing fnbpaint / cnn-nav.landing fnbpaint + 3 more (Linux, OSX, Windows) regression on Thu December 2 2021

Status: RESOLVED WONTFIX

(Testing :: Raptor, defect, P4)

Description

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Perfherder has detected a browsertime performance regression from push 892479e32b1a183eb1d8c7464e5d5d0077a52017. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
196%	cnn-nav.landing fnbpaint	macosx1014-64-shippable-qr	cold fission webrender	319.25 -> 945.58
154%	cnn-nav.landing fnbpaint	windows10-64-shippable-qr	cold webrender	310.42 -> 788.42
145%	cnn-nav.landing fnbpaint	macosx1015-64-shippable-qr	cold fission webrender	296.67 -> 726.25
113%	cnn-nav.landing fnbpaint	linux1804-64-shippable-qr	cold fission webrender	373.75 -> 794.83
110%	cnn-nav.landing fnbpaint	linux1804-64-shippable-qr	cold webrender	367.08 -> 770.58

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
77%	cnn-nav.world loadtime	windows10-64-shippable-qr	cold webrender	4,318.83 -> 1,009.08
75%	cnn-nav.world loadtime	macosx1015-64-shippable-qr	cold fission webrender	3,468.42 -> 868.33
72%	cnn-nav.world LastVisualChange	windows10-64-shippable-qr	cold webrender	4,309.79 -> 1,211.04
71%	cnn-nav.world LastVisualChange	macosx1015-64-shippable-qr	cold fission webrender	3,615.00 -> 1,048.33
68%	cnn-nav.world loadtime	linux1804-64-shippable-qr	cold webrender	3,074.17 -> 989.17
...	...	...	...	...
5%	cnn-nav.landing dcf	macosx1015-64-shippable-qr	cold fission webrender	710.92 -> 673.00

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Comment 1

[Greg Mierzwinski [:sparky]]

This is expected, we re-recorded the cnn-nav test on linux rather than windows.

Comment 2

[Greg Mierzwinski [:sparky]]

:alexandrui do you need anything else from me?