695556 - allow remote tests to run with a python webserver instead of xpcshell+httpd.js

Status: RESOLVED WONTFIX

(Testing :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

it is very difficult to setup testing for android.  One of the most confusing pieces is the requirement for a host binary and tests package.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: use a python http server instead of xpcshell for remote testing (1.0)

this patch is not in a reviewable state, but does work for desktop mochitest and remote reftests.  Probably about 75% done atm.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

here is an example command line I ran to do this:
python remotereftest.py --app org.mozilla.fennec --dm_trans=adb --deviceIP=1.2.3.4 --ignore-window-size tests/layout/reftests/reftest-sanity/reftest.list

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

these fail on a tegra for reftest-1 vs the xpcshell webserver:
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/jpeg/webcam-simulacrum.mjpg | load failed: null
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/gif/webcam.html | image comparison (==) 
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/generic/accept-image-catchall.html | image comparison (==) 
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/layout/reftests/backgrounds/root-background-1.html | image comparison (!=)