823703 - Create and use an android-specific xpcshell manifest

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: General, defect)

Description

[Geoff Brown [:gbrown]]

To run android xpcshell tests in continuous integration, we want to start with a very small set of tests that we know will pass. As time permits, we will investigate failures and grow the list of supported tests.

We could use skip-if = os == 'android' in the main xpcshell.ini, but the preferred short-term solution is to create and use our own manifest, like xpcshell_b2g.ini.

Comment 1

[Geoff Brown [:gbrown]]

I know that gfx/tests passes and has been well-behaved for many weeks now.

Sample run from a pandaboard:

mozdev@mozdev-virtual-machine:/media/extra/objdir-native-droid$ make -C gfx/tests xpcshell-tests-remote
make: Entering directory `/media/extra/objdir-native-droid/gfx/tests'
/media/extra/objdir-native-droid/_virtualenv/bin/python -u /home/mozdev/src/config/pythonpath.py \
	  -I/home/mozdev/src/build \
	  -I/home/mozdev/src/build/mobile \
	  -I/home/mozdev/src/testing/mozbase/mozdevice/mozdevice \
	  /home/mozdev/src/testing/xpcshell/remotexpcshelltests.py \
	  --symbols-path=../../dist/crashreporter-symbols \
	  --build-info-json=../../mozinfo.json \
	  --testing-modules-dir=../../_tests/modules \
	   \
	  --dm_trans=sut \
	  --deviceIP=192.168.0.111 \
	  --objdir=../.. \
	  ../../_tests/xpcshell/gfx/tests/unit
using APK: ../../dist/fennec-20.0a1.en-US.android-arm.apk
Pushing libmozalloc.so..
Pushing libxul.so..
This is a big file, it could take a while.
Pushing libplc4.so..
Pushing libnss3.so..
Pushing libnssutil3.so..
Pushing libplds4.so..
Pushing libxpcom.so..
Pushing libsmime3.so..
Pushing libfreebl3.so..
Pushing libnssckbi.so..
Pushing libssl3.so..
Pushing libsoftokn3.so..
Pushing libmozsqlite3.so..
Pushing libnspr4.so..
pushing directory: ../../_tests/modules to /mnt/sdcard/tests/xpcshell/m
pushing ../../_tests/xpcshell (attempt 1 of 10)
pushing directory: ../../_tests/xpcshell to /mnt/sdcard/tests/xpcshell
TEST-INFO | /media/extra/objdir-native-droid/_tests/xpcshell/gfx/tests/unit/test_nsIScriptableRegion.js | running test ...
TEST-PASS | /media/extra/objdir-native-droid/_tests/xpcshell/gfx/tests/unit/test_nsIScriptableRegion.js | test passed (time: 797.169ms)
INFO | Result summary:
INFO | Passed: 1
INFO | Failed: 0
INFO | Todo: 0
make: Leaving directory `/media/extra/objdir-native-droid/gfx/tests'

Comment 2

[Geoff Brown [:gbrown]]

Attachment: create and use xpcshell_android.ini

There's *no* rush on this review -- we'll sort it out next year!

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 694670 [details] [diff] [review]
create and use xpcshell_android.ini

Review of attachment 694670 [details] [diff] [review]:
-----------------------------------------------------------------

awesome!  My only concern here is that the make target might confuse folks; I think we should stick with it and if tests are missing they can ensure the specific tests are passing ;)

Comment 4

[Geoff Brown [:gbrown]]

Agreed!

https://hg.mozilla.org/integration/mozilla-inbound/rev/2954ab7bab89

Comment 5

[:Ms2ger (he/him; ⌚ UTC+1/+2)]

https://hg.mozilla.org/mozilla-central/rev/2954ab7bab89