Add missing Android 4.3 test suites: cppunittests, jittests, instrumentation

RESOLVED WONTFIX

Status

defect
RESOLVED WONTFIX
4 years ago
3 years ago

People

(Reporter: gbrown, Assigned: gbrown)

Tracking

Trunk
x86_64
Linux
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(2 attachments)

I'm hoping we can start running some Android 4.3 Opt emulator tests soon, and gradually removing corresponding jobs from Android 4.0 Opt. The 4.3 test suite configs are mirrors of their closest cousins, the Android 2.3 tests: xpcshell, mochitest, reftest, crashtest, jsreftest, robocop. 

There are some additional Android 4.0 test suites which I should probably try to get running on 4.3:

cppunittests - running on all trees in Android 4.0 Opt (but not 2.3, not x86) and running in Android 4.0 Debug only on Cedar
jittests - Opt and Debug running only on Cedar
instrumentation - Opt running only on Cedar
The jittests on Android have never been green since they've been enabled on Cedar (Dec 2013, maybe?). I don't think it's worth spending your time getting them running on the emulator until the js team has time available to investigate and fix the failures. Bug 1098508 has some dependent bugs for the failures from the last time I went through them.

AFAIK the jittests are also enabled on Try for Android 4.0, but hidden by default.
Depends on: 1140148
I can run cppunit tests successfully on 4.3 with these changes:

http://ftp.mozilla.org/pub/mozilla.org/mobile/try-builds/gbrown@mozilla.com-4aba3befeb42/try-android-api-9/try_ubuntu64_vm_mobile_test-xpcshell-3-bm116-tests1-linux64-build63.txt.gz

17:05:42     INFO -  SUITE-END | took 715s
17:05:42     INFO -  Result summary:
17:05:42     INFO -  cppunittests INFO | Passed: 90
17:05:42     INFO -  cppunittests INFO | Failed: 0

Updated

4 years ago
Attachment #8583430 - Flags: review?(dminor) → review+

Updated

4 years ago
Attachment #8583388 - Flags: review?(dminor) → review+
Leaving open in case we want to do something for jit and instrumentation tests. (These are not a priority, but to retire the Pandas completely, we need to do something about the suites running on Cedar/Try.)
Keywords: leave-open
From irc today:

<RyanVM|sheriffduty> kmoir|buildduty: are android 4.3 Jit tests on your radar?
<kmoir|buildduty> RyanVM|sheriffduty: I think gbrown mentioned those and cpp tests were the next ones he was going to green up in the mobile mtg 
<RyanVM|sheriffduty> great
<RyanVM|sheriffduty> we hadn't been running them on 4.0 because they weren't green and nobody took up making them so
<RyanVM|sheriffduty> so would be nice :)
See Also: → 1064012
See Also: → 1098508
cppunit tests run on Android 4.3. Other bugs cover instrumentation and jit-tests. I don't see much purpose to this bug any longer.
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.