Closed Bug 1146574 Opened 6 years ago Closed 5 years ago

Add missing Android 4.3 test suites: cppunittests, jittests, instrumentation

Categories

(Testing :: General, defect)

x86_64
Linux
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: gbrown, Assigned: gbrown)

References

Details

Attachments

(2 files)

I'm hoping we can start running some Android 4.3 Opt emulator tests soon, and gradually removing corresponding jobs from Android 4.0 Opt. The 4.3 test suite configs are mirrors of their closest cousins, the Android 2.3 tests: xpcshell, mochitest, reftest, crashtest, jsreftest, robocop. 

There are some additional Android 4.0 test suites which I should probably try to get running on 4.3:

cppunittests - running on all trees in Android 4.0 Opt (but not 2.3, not x86) and running in Android 4.0 Debug only on Cedar
jittests - Opt and Debug running only on Cedar
instrumentation - Opt running only on Cedar
The jittests on Android have never been green since they've been enabled on Cedar (Dec 2013, maybe?). I don't think it's worth spending your time getting them running on the emulator until the js team has time available to investigate and fix the failures. Bug 1098508 has some dependent bugs for the failures from the last time I went through them.

AFAIK the jittests are also enabled on Try for Android 4.0, but hidden by default.
Depends on: 1140148
I can run cppunit tests successfully on 4.3 with these changes:

http://ftp.mozilla.org/pub/mozilla.org/mobile/try-builds/gbrown@mozilla.com-4aba3befeb42/try-android-api-9/try_ubuntu64_vm_mobile_test-xpcshell-3-bm116-tests1-linux64-build63.txt.gz

17:05:42     INFO -  SUITE-END | took 715s
17:05:42     INFO -  Result summary:
17:05:42     INFO -  cppunittests INFO | Passed: 90
17:05:42     INFO -  cppunittests INFO | Failed: 0
Attachment #8583430 - Flags: review?(dminor) → review+
Attachment #8583388 - Flags: review?(dminor) → review+
Leaving open in case we want to do something for jit and instrumentation tests. (These are not a priority, but to retire the Pandas completely, we need to do something about the suites running on Cedar/Try.)
Keywords: leave-open
From irc today:

<RyanVM|sheriffduty> kmoir|buildduty: are android 4.3 Jit tests on your radar?
<kmoir|buildduty> RyanVM|sheriffduty: I think gbrown mentioned those and cpp tests were the next ones he was going to green up in the mobile mtg 
<RyanVM|sheriffduty> great
<RyanVM|sheriffduty> we hadn't been running them on 4.0 because they weren't green and nobody took up making them so
<RyanVM|sheriffduty> so would be nice :)
See Also: → 1064012
See Also: → 1098508
cppunit tests run on Android 4.3. Other bugs cover instrumentation and jit-tests. I don't see much purpose to this bug any longer.
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → WONTFIX
Keywords: leave-open
You need to log in before you can comment on or make changes to this bug.