1675011 - 2 - 2.88% Images (linux1804-64-shippable, linux1804-64-shippable-qr, windows10-64-shippable-qr) regression on push f710456fd07e3108c646990b391b8ee41f493c41 (Fri October 30 2020)

Status: RESOLVED INVALID

(Core :: Performance, defect)

Description

[Andra Esanu (needinfo me)]

Perfherder has detected a awsy performance regression from push f710456fd07e3108c646990b391b8ee41f493c41. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio	Suite	Test	Platform	Options	Absolute values (old vs new)
3%	Images		linux1804-64-shippable-qr		5,714,059.29 -> 5,878,523.20
3%	Images		linux1804-64-shippable		5,531,115.90 -> 5,684,288.45
3%	Images		linux1804-64-shippable-qr		5,720,107.31 -> 5,865,520.33
3%	Images		windows10-64-shippable-qr		7,675,958.12 -> 7,868,891.79
2%	Images		linux1804-64-shippable-qr		5,608,080.55 -> 5,720,275.11

Improvements:

Ratio	Suite	Test	Platform	Options	Absolute values (old vs new)
3%	Heap Unclassified		windows10-64-shippable-qr	tp6	72,021,223.85 -> 69,955,659.48

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1674349

Comment 2

[James Graham [:jgraham]]

The commit being pointed at only affects test metadata so I don't think it can be the correct one causing this regression.

Comment 3

[Andra Esanu (needinfo me)]

Thanks for letting me know, I will mark this as INVALID.