1732218 - octane 2.0 only gets 4603 in B2G

Status: RESOLVED INVALID

(Core :: JavaScript Engine: JIT, defect, P2)

Description

[penglong]

Attachment: application.zip

User Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36

Steps to reproduce:

1. We ported B2G (Firefox 92 64bit ) to the khadas VIM3 board following instructions from https://github.com/kaiostech.
2. Run the attached Octane 2.0 benchmark test app, and only gets a score of 4603.

Expected results:

A score above 10k.

Comment 1

[[:fabrice] Fabrice Desré]

Is there a difference with Firefox running on the same chipset?

Comment 2

[penglong]

(In reply to [:fabrice] Fabrice Desré from comment #1)

Is there a difference with Firefox running on the same chipset?

We will try android and report back to you.

Comment 3

[penglong]

(In reply to [:fabrice] Fabrice Desré from comment #1)

Is there a difference with Firefox running on the same chipset?
Hi @Fabrice,

After some tests on the VIM3 board with 32bit Android Pie, we got some interesting results.

1. With Firefox for Android Version 92.1, the octane benchmark score is 5769.
2. With Fennec 68.9, the score is 7829.
   It seems that the performance of Firefox Android doesn't upgrade with the gecko version.
   We also did the tests on the rockchip RK3399 Boards, and have the same conclusion.

Could you please do the test on your platform, and at least confirm if this is indeed a defect.

Br,
Long

Comment 4

[:gerard-majax]

Is it possible you could check on 64-bits Android as well ?

Comment 5

[penglong]

(In reply to Alexandre LISSY :gerard-majax from comment #4)

Is it possible you could check on 64-bits Android as well ?

@Alexandre There is no public Android 64bit Android available. I did the test on an rockchip RK3399 Board with 64bit Android N, while firefox is 32 bit. I get the same result.

Comment 6

[:gerard-majax]

(In reply to penglong from comment #5)

(In reply to Alexandre LISSY :gerard-majax from comment #4)

Is it possible you could check on 64-bits Android as well ?

@Alexandre There is no public Android 64bit Android available. I did the test on an rockchip RK3399 Board with 64bit Android N, while firefox is 32 bit. I get the same result.

Last I checked, our android packages were aarch64.

Comment 7

[[:fabrice] Fabrice Desré]

Also note that Octane is a deprecated benchmark, so it's not surprising that engines don't optimize for it. The https://browserbench.org/ benchmarks are the most up to date as far as I know.

Comment 8

[Iain Ireland [:iain]]

The V8 dev blog has a good post about why we no longer prioritize Octane.

Comment 9

[penglong]

Thank @Favrice and Iain. I will close the issue.