it is very difficult to setup testing for android. One of the most confusing pieces is the requirement for a host binary and tests package.
Created attachment 567922 [details] [diff] [review] use a python http server instead of xpcshell for remote testing (1.0) this patch is not in a reviewable state, but does work for desktop mochitest and remote reftests. Probably about 75% done atm.
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
here is an example command line I ran to do this: python remotereftest.py --app org.mozilla.fennec --dm_trans=adb --deviceIP=18.104.22.168 --ignore-window-size tests/layout/reftests/reftest-sanity/reftest.list
these fail on a tegra for reftest-1 vs the xpcshell webserver: REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/jpeg/webcam-simulacrum.mjpg | load failed: null REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/gif/webcam.html | image comparison (==) REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/generic/accept-image-catchall.html | image comparison (==) REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/layout/reftests/backgrounds/root-background-1.html | image comparison (!=)
Component: New Frameworks → General
Product: Testing → Testing
You need to log in before you can comment on or make changes to this bug.