Open Bug 584273 Opened 10 years ago Updated 9 years ago

Mac OS X 10.6 Ts performance numbers got much noisier on July 30

Categories

(Core :: General, defect)

x86
macOS
defect
Not set

Tracking

()

People

(Reporter: dbaron, Unassigned)

Details

(Keywords: perf, regression)

URL for the graph that Bugzilla won't break: http://bit.ly/cVnzNV
josh can we back this out to see what happens?
Backed out.
Maybe I'm not reading the graph correctly, but it doesn't look like backing out bug 531552 changed anything. Can someone else confirm?
On second thought, I think we need to wait a little longer to make a determination.
I think the backout fixed it, although I'm not quite sure yet.  (It would really help to be able to look at just the points without the lines, since the lines add noise since each slave runs the test so rarely.)
Actually, I'm pretty confident the backout (or something else around end of day August 3 or early morning August 4) fixed it.
It seems that the standard deviation changed but not the average, which is pretty strange. I can think of reasons why my patch might make startup slower, but I can't think of reasons why it would make as many runs go faster.
The SQLite upgrade got backed out around the timeframe in comment 7, but it didn't land when this started.
I landed a simplified version of Josh's patch for bug 531552 on the
trunk on 2011-01-03 (see bug 531522 comment #166).  Since then the Ts
performance numbers have (I think) gotten slightly noisier, but
nothing like what happened when Josh' patch landed (on 2010-07-30, bug
531522 comment #117).

I suggest this slight increase in noisiness isn't a problem.  What do
you think, dbaron?

(And in any case, the greater noisiness is small enough that it's hard
to detect exactly when it started, or to be sure it won't just go
away.)
You need to log in before you can comment on or make changes to this bug.