920221 - Add --bootstrap and --enable-privilege arguments for android x86 reftests

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Geoff Brown [:gbrown]]

Two command line arguments:

 --bootstrap
 --enable-privilege

are used for Android 2.2 reftests (jsreftests, crashtests, and plain-reftest) but not for Android 4.0 plain-reftests and not for Android x86 (all reftests).

:jmaher recommends using both arguments.

Preliminary tests suggest that running with these arguments on x86 significantly decreases plain-reftest run time and does not cause any additional failures.

dminor is going to follow-up for Android 4.0/Panda.

I am running more tests on the loaner.

Comment 1

[Geoff Brown [:gbrown]]

Attachment: add reftest options

Comment 2

[Geoff Brown [:gbrown]]

https://hg.mozilla.org/build/mozharness/rev/c62da9566dd1

Comment 3

[Geoff Brown [:gbrown]]

Comparing tests before and after check-in at https://tbpl.mozilla.org/?tree=Cedar&rev=1f3ab05e73e0, there is some improvement in run-time, but it doesn't seem consistent, and not as significant as I saw on the loaner:

crashtest-1  0:25:11.874631 -> 0:23:31.292969
jsreftest-1  0:46:08.039488 -> 0:52:50.745696
reftest-1    1:00:52.810226 (705 / 1213) -> 1:00:51.258885 (743 / 1213)

Comment 4

[Masatoshi Kimura [:emk]]

Why --enable-privilege is needed? It is no-op since bug 913510.