Investigate if there is something in MotionMark benchmark to improve

NEW
Unassigned

Status

()

Core
Graphics
P3
normal
a year ago
6 months ago

People

(Reporter: smaug, Unassigned)

Tracking

({perf})

Trunk
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [gfx-noted])

(Reporter)

Description

a year ago
https://webkit.org/blog/6943/motionmark-a-new-graphics-benchmark/

Based on the initial profiling and the explanation in that blog hint that it is pretty much all about gfx. I haven't compared FF to other browsers.
There was some discussion in bug 1276713, and bug 1108052 improved parts of this benchmark.  There is also a Servo bug to make sure we can run this benchmark there.
Has STR: --- → irrelevant
Keywords: perf
OS: Unspecified → All
Priority: -- → P4
Hardware: Unspecified → All
Whiteboard: [gfx-noted]
Priority: P4 → P3
Test results from my MacBook Pro running macOS 10.12:

Chrome 53  = 290.42
Safari 10  = 267.37
Firefox 49 =  93.02
Nightly 52 =  85.68
Depends on: 1108052
Version: 36 Branch → Trunk
(Reporter)

Comment 3

a year ago
FWIW, the test behaves oddly on linux. I get 17.52 on Nightly and 1.32 Chrome (dev).

Comment 4

9 months ago
I see 5x worse performance in Linux that OS X, on the same hardware (an old Mac Mini "late 2009").  I also used Epiphany on Linux, since it uses the same engine as Safari, WebKit 2.

| Browser        | OS X 10.11.6     | Ubuntu 16.04 LTS
| -------------- | ---------------- | ---------------- 
| Firefox        | 56.69 ± 4.73%    | 10.25 ± 33.21%
| Safari         | 148.70 ± 15.11%  | -
| Epiphany       | -                | 7.58 ± 47.48%
| Chrome         | 62.23 ± 13.54%   | 49.96 ± 10.67%

Seeing how Chrome manages much closer results on Linux and OS X, it seems there's some room for improvement for Firefox on Linux.  Ubuntu 16.04 LTS came with Firefox 49, but I repeated the test with Firefox 52 in Fedora 26 Alpha Workstation (which uses Wayland), and only got a marginally better score, 12.0.  Doesn't Firefox also use Skia as its graphics backend nowadays, just as Chrome?

Interestingly, disabling the hardware acceleration in Firefox results in the MotionMark score jumping from 10.25 to 18.02±8.47% on Linux, but it drops from 56.69 to just 7 on OS X.

The JetStream scores are slightly better on Linux than on OS X (with no big differences among browsers), so it's probably just a graphics problem.

Comment 5

6 months ago
On Windows 7:

Nightly / Chrome 59

Overall           63.02 ±4.83%   / 115.73 ±6.72%

Multiply          39.39 ±1.87%   / 167.75 ±2.11%
Canvas Arcs      363.94 ±1.90%   / 149.87 ±2.58%
Leaves           101.19 ±2.14%   / 158.32 ±5.34%
Paths           1083.14 ±19.95%  / 322.29 ±3.60%
Canvas Lines     751.14 ±1.77%   / 1573.23 ±1.39%
Focus              4.67 ±1.84%   / 18.50 ±5.80%
Images            16.71 ±2.17%   / 47.83 ±3.07%
Design             5.28 ±6.02%   / 33.62 ±13.08%
Suits             32.29 ±4.25%   / 62.06 ±27.73%
You need to log in before you can comment on or make changes to this bug.