4.95% build times (windows2012-64) regression on push 1286d4b97efd3623db92b28472707c6fc4496d55 (Tue September 10 2019)
Categories
(Firefox Build System :: General, defect)
Tracking
(firefox71 affected)
Tracking | Status | |
---|---|---|
firefox71 | --- | affected |
People
(Reporter: marauder, Unassigned)
References
(Regression)
Details
(Keywords: perf-alert, regression)
We have detected a build metrics regression from push:
As author of one of the patches included in that push, we need your help to address this regression.
Regressions:
5% build times windows2012-64 debug plain taskcluster-c4.4xlarge 2,311.34 -> 2,425.70
You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=23190
On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the jobs in a pushlog format.
To learn more about the regressing test(s), please see: https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Automated_Performance_Testing_and_Sheriffing/Build_Metrics
*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***
Reporter | ||
Updated•5 years ago
|
Comment 1•5 years ago
|
||
The numbers in the alert make it look much worse when it actually is: looking at the build on the landing of bug 1579156, its value is 2337, not 2425. And the push before had 2283, which, if you look at older things, was actually particularly on the low end. Even using that the alert as shown by the graph is 2.4%. But if you account for the fact that most values were already above 2300, and that the overall decrease is almost invisible in the graph, I'm going to call this WONTFIX.
Although, for the record, there is a difference between before bug 1573566 and after bug 1579156: the binding tests are compiled later, and that may be the cause for this small regression.
Reporter | ||
Comment 2•5 years ago
|
||
Thanks for the details, Mike.
Updated•2 years ago
|
Description
•