1603103 - 2.29 - 3.18% Explicit Memory (windows7-32, windows7-32-shippable) regression on push 95e0180f6a40275d54ae910a68c46f61e22b6854 (Wed December 4 2019)

Status: RESOLVED DUPLICATE of bug 1603678

(Testing :: Performance, defect)

Description

[Alexandru Ionescu (needinfo me) [:alexandrui]]

We have detected an awsy regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=95e0180f6a40275d54ae910a68c46f61e22b6854

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

3% Explicit Memory windows7-32-shippable opt 292,050,017.04 -> 301,342,667.60
2% Explicit Memory windows7-32 opt 292,529,978.24 -> 299,596,814.31
2% Explicit Memory windows7-32 opt 293,403,644.06 -> 300,135,796.56

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=24436

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/AWSY/Tests

Comment 1

[Eric Rahm [:erahm]]

I'm not totally convinced that range is correct, it looks like https://hg.mozilla.org/integration/autoland/rev/3a083701018bf872acfc5e391312042d8d246aa4 landed shortly after and could correlate with an increase.

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Yeah, it's actually one commit before. Sorry!

Comment 3

[Ryan VanderMeulen [:RyanVM]]

Why was this marked invalid? Did the numbers return to normal?

Comment 5

[Alexandru Ionescu (needinfo me) [:alexandrui]]

(In reply to Ryan VanderMeulen [:RyanVM] from comment #3)

Why was this marked invalid? Did the numbers return to normal?

The culprit was another commit.