427481 - Sunspider test suite 6% slower in Camino compared to Minefield builds

Status: RESOLVED INCOMPLETE

(Camino Graveyard :: General, defect)

Description

[philippe (part-time)]

The sunspider javascript benchmark suite is consistently slower when using Camino.

Results for one run (numbers are in the same range over various runs, various builds):
Minefield	Camino
3500.6ms	3720.0ms

Tests with a default profile for both browsers, on a consumer iMac (core2 duo, 2Ghz, 2Gb ram).

Filed as UNCO, not sure if this is really a Camino bug or if there is an underlying Core bug.

Comment 1

[philippe (part-time)]

Attachment: sunspider results, Camino

Camino build: 2.0a1pre (1.9pre 2008040622)

Comment 2

[philippe (part-time)]

Attachment: sunspider results, Minefield

build: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9pre) Gecko/2008040623 Minefield/3.0pre

Comment 3

[Eiichi]

I didn't test Minefield, but for reference.
Tests with my own build, on a MacBookPro ( Core 2 Duo, 2.16 GHz, 2 GB RAM).

Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en; rv:1.9pre) 
Gecko/2008040717 Camino/2.0a1pre (like Firefox/3.0pre) 
Total:                 3485.4ms +/- 0.3%

Comment 4

[Eiichi]

Attachment: Sunspider Results

Comment 5

[Eiichi]

Attachment: Sunspider Results

Comment 6

[Eiichi]

Test with Official Nigtly Build (2008040700)

================================
RESULTS (means and 95% confidence intervals)
--------------------------------------------
Total:                 3513.8ms +/- 0.6%
--------------------------------------------

Comment 7

[:Gavin Sharp [email: [e-mail]]]

Are you testing Minefield nightlies? They're built with PGO (http://developer.mozilla.org/en/docs/Building_with_Profile-Guided_Optimization), and that resulted in about a 10% gain in SunSpider numbers, if I recall correctly - your Camino build isn't, presumably.

Comment 8

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

(In reply to comment #7)
> Are you testing Minefield nightlies? They're built with PGO

On the Mac?  My understanding is that PGO was not being used on the Mac because there were too many obstacles for this stage in the game (bug 417045), and that wiki page you cited only talks about Windows.

Comment 9

[:Gavin Sharp [email: [e-mail]]]

Oh, I thought Camino was a Windows browser that used native win32 widgets.

(You're right of course, not sure what I was thinking.)

Comment 10

[Stuart Morgan]

Shark information from a complete run in each browser would be helpful, so we can see if the extra time is anywhere obvious.

Comment 11

[Chris Lawson (gone)]

This is obviously happening, so I'm going to confirm it, and if it turns out it's a Core bug (which we'll probably know once we get Shark info), we'll have plenty of information to give them when we kick it over there.

Comment 12

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

Reports are the 1.9.2 experimental builds are faster than Firefox 3.6 at sunspider, and since we've never gotten Shark profiles here, I think we should probably just WONTFIX this one.