allow remote tests to run with a python webserver instead of xpcshell+httpd.js

ASSIGNED
Assigned to

Status

ASSIGNED
7 years ago
9 months ago

People

(Reporter: jmaher, Assigned: jmaher)

Tracking

Trunk
ARM
Android
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [mozbase])

Attachments

(1 attachment)

(Assignee)

Description

7 years ago
it is very difficult to setup testing for android.  One of the most confusing pieces is the requirement for a host binary and tests package.
(Assignee)

Comment 1

7 years ago
Created attachment 567922 [details] [diff] [review]
use a python http server instead of xpcshell for remote testing (1.0)

this patch is not in a reviewable state, but does work for desktop mochitest and remote reftests.  Probably about 75% done atm.
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
(Assignee)

Comment 2

7 years ago
here is an example command line I ran to do this:
python remotereftest.py --app org.mozilla.fennec --dm_trans=adb --deviceIP=1.2.3.4 --ignore-window-size tests/layout/reftests/reftest-sanity/reftest.list
(Assignee)

Comment 3

7 years ago
these fail on a tegra for reftest-1 vs the xpcshell webserver:
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/jpeg/webcam-simulacrum.mjpg | load failed: null
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/gif/webcam.html | image comparison (==) 
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/image/test/reftest/generic/accept-image-catchall.html | image comparison (==) 
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.199:8888/tests/layout/reftests/backgrounds/root-background-1.html | image comparison (!=)

Updated

7 years ago
Whiteboard: [mozbase]
Component: New Frameworks → General
Product: Testing → Testing
You need to log in before you can comment on or make changes to this bug.