1513695 - Error when running w-p-t in Android emulator: "Loading initial page http://web-platform.test:8000/testharness_runner.html failed"

Status: NEW

(Testing :: web-platform-tests, defect)

Description

[Botond Ballo [:botond]]

Attachment: Full output

I am trying to run a web platform test using the Android emulator, but I'm getting the following error:

 3:12.41 CRITICAL Loading initial page http://web-platform.test:8000/testharness_runner.html failed. Ensure that the there are no other programs bound to this port and that your firewall rules or network setup does not prevent access.\eTraceback (most recent call last):

I did check that nothing else is using port 8000.

I've attached the full output.

Comment 1

[Geoff Brown [:gbrown]]

Unfortunately, this works for me:

gbrown@mozpad2:~/src$ ./mach wpt testing/web-platform/tests/css/css-shapes/shape-outside/values/shape-margin-001.html --package=org.mozilla.fennec_aurora
 0:00.00 INFO Creating config file /home/gbrown/objdirs/x86/_tests/web-platform/wptrunner.local.ini
 0:00.00 INFO Creating directory /home/gbrown/objdirs/x86/_tests/web-platform/meta
 0:00.00 INFO Creating directory /home/gbrown/objdirs/x86/_tests/web-platform/mozilla/meta
 0:01.90 INFO Downloading manifest from https://index.taskcluster.net/v1/task/gecko.v2.mozilla-central.revision.e27e7c02c708b052a53e39d35d81d8318d8730f1.source.manifest-upload/artifacts/public/manifests.tar.gz
 0:14.94 adb INFO Using adb 1.0.40
 0:15.23 adb INFO adbd running as root
 0:15.50 adb INFO su 0 supported
 0:15.77 adb INFO /system/bin/ls -1A supported
 0:15.90 adb INFO Native cp support: True
 0:16.04 adb INFO Native chmod -R support: True
 0:16.17 adb INFO Native chown -R support: True
 0:16.30 adb INFO Setting SELinux Permissive
Granting important runtime permissions to org.mozilla.fennec_aurora
 0:21.67 INFO Using 1 client processes
 0:21.73 INFO STDERR: INFO:root:Installed font: Ahem.ttf
 0:21.79 INFO Starting http server on 192.168.0.6:8000
 0:21.79 INFO Starting http server on 192.168.0.6:8001
 0:21.80 INFO Starting https server on 192.168.0.6:8443
 0:22.28 SUITE_START: web-platform-test - running 1 tests
 0:22.28 INFO Running reftest tests
 0:22.29 INFO No reftest tests to run
 0:22.29 INFO Running wdspec tests
 0:22.29 ERROR Unsupported test type wdspec for product fennec
 0:22.29 INFO Running testharness tests
 0:22.31 INFO Setting up ssl
 0:22.40 certutil Full command: /home/gbrown/.mozbuild/android-device/host-utils-61.0a1.en-US.linux-x86_64/certutil -N -d /tmp/tmpVcN6YI.mozrunner -f /tmp/tmpVcN6YI.mozrunner/.crtdbpw
certutil 
 0:22.48 certutil 
 0:22.53 certutil 
Certificate Nickname                                         Trust Attributes
                                                             SSL,S/MIME,JAR/XPI

web-platform-tests                                           CT,, 

 0:22.55 adb INFO Using adb 1.0.40
 0:22.82 adb INFO adbd running as root
 0:23.07 adb INFO su 0 supported
 0:23.34 adb INFO /system/bin/ls -1A supported
 0:23.48 adb INFO Native cp support: True
 0:23.62 adb INFO Native chmod -R support: True
 0:23.75 adb INFO Native chown -R support: True
 0:23.89 adb INFO Setting SELinux Permissive
 0:25.95 adb WARNING Ignoring attempt to chmod external storage
 0:32.16 INFO STDOUT: timed out waiting for profiles.ini
 0:32.60 adb INFO Granting important runtime permissions to org.mozilla.fennec_aurora
 0:34.05 adb INFO launch_application: am start -W -n org.mozilla.fennec_aurora/org.mozilla.gecko.BrowserApp -a android.intent.action.VIEW --es env9 MOZ_PROCESS_LOG=/tmp/tmp3Zzv4qpidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=1 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4,MediaPipelineFactory:4 --es env10 R_LOG_LEVEL=6
 0:36.22 INFO Starting runner
 0:38.09 TEST_START: /css/css-shapes/shape-outside/values/shape-margin-001.html
 0:38.80 TEST_END: Test OK. Subtests passed 20/26. Unexpected 4
FAIL 10vw - computed - assert_equals: expected "40px" but got "98px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
FAIL 10vh - computed - assert_equals: expected "56px" but got "137.2px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
FAIL 10vmin - computed - assert_equals: expected "40px" but got "98px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
FAIL 10vmax - computed - assert_equals: expected "56px" but got "137.2px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9

 0:38.80 INFO Pausing until the browser exits

<<< I had to manually close the browser in the emulator here >>>

 1:11.24 INFO No more tests
 1:12.12 INFO Closing logging queue
 1:12.12 INFO queue closed
 1:12.52 INFO Got 4 unexpected results
 1:12.52 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 27 checks (1 tests, 26 subtests)
Expected results: 23
Unexpected results: 4
  subtest: 4 (4 fail)

Unexpected Results
------------------
/css/css-shapes/shape-outside/values/shape-margin-001.html
  FAIL 10vw - computed - assert_equals: expected "40px" but got "98px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
  FAIL 10vh - computed - assert_equals: expected "56px" but got "137.2px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
  FAIL 10vmin - computed - assert_equals: expected "40px" but got "98px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
  FAIL 10vmax - computed - assert_equals: expected "56px" but got "137.2px"
testShapeMarginComputedStyle@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:60:9
setupFonts/<@http://web-platform.test:8000/css/css-shapes/shape-outside/values/support/parsing-utils.js:462:13
generate_tests/</<@http://web-platform.test:8000/resources/testharness.js:769:30
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1568:20
test@http://web-platform.test:8000/resources/testharness.js:544:21
generate_tests/<@http://web-platform.test:8000/resources/testharness.js:767:21
forEach@http://web-platform.test:8000/resources/testharness.js:3099:17
generate_tests@http://web-platform.test:8000/resources/testharness.js:764:9
@http://web-platform.test:8000/css/css-shapes/shape-outside/values/shape-margin-001.html:30:9
 1:12.60 INFO STDERR: INFO:root:Removed font: Ahem.ttf
 1:12.60 INFO STDERR: INFO:root:Removed font: Ahem.ttf
 1:12.63 INFO Closing logging queue
 1:12.63 INFO queue closed


(I didn't have a local build, so installed a nightly and used --package= to select fennec_aurora...but that shouldn't make a difference).

Comment 2

[Geoff Brown [:gbrown]]

(In reply to Botond Ballo [:botond] from comment #0)
> Created attachment 9030900 [details]
> Full output
> 
> I am trying to run a web platform test using the Android emulator, but I'm
> getting the following error:
> 
>  3:12.41 CRITICAL Loading initial page
> http://web-platform.test:8000/testharness_runner.html failed. Ensure that
> the there are no other programs bound to this port and that your firewall
> rules or network setup does not prevent access.\eTraceback (most recent call
> last):
> 
> I did check that nothing else is using port 8000.
> 
> I've attached the full output.

That seems like there's something interfering with the emulator from seeing that ip/port.

The attachment shows

 0:29.19 INFO Starting http server on 10.242.24.73:8000

Can the emulator ping the host?  adb shell ping 10.242.24.73 ?


But maybe the connection message is misleading? There's also

 3:07.11 WARNING Timed out waiting for browser to start

so I wonder, do you see Firefox start on the emulator? What is in the url bar? Is there any page load?

Comment 3

[Botond Ballo [:botond]]

(In reply to Geoff Brown [:gbrown] from comment #2)
> The attachment shows
> 
>  0:29.19 INFO Starting http server on 10.242.24.73:8000
> 
> Can the emulator ping the host?  adb shell ping 10.242.24.73 ?

Yep, that works fine.

> But maybe the connection message is misleading? There's also
> 
>  3:07.11 WARNING Timed out waiting for browser to start
> 
> so I wonder, do you see Firefox start on the emulator? 

I do.

> What is in the url bar? 

Nothing, it just stays on the start page (and then the app closes when the timeout is reached).

> Is there any page load?

Nope.

Comment 4

[Botond Ballo [:botond]]

Attachment: Logcat from emulator

I got a logcat from the emulator as well (attached), perhaps there is some relevant information there.

Comment 5

[Geoff Brown [:gbrown]]

(In reply to Botond Ballo [:botond] from comment #3)
> (In reply to Geoff Brown [:gbrown] from comment #2)
> > What is in the url bar? 
> 
> Nothing, it just stays on the start page (and then the app closes when the
> timeout is reached).

That seems strange. Maybe there is something going wrong in marionette, preventing it from requesting the page load? I don't see any marionette logging in the logcat...but I'm not sure if that indicates a problem.

You are using a local build? Does your MOZCONFIG contain

ac_add_options --enable-marionette

?

Comment 6

[James Graham [:jgraham]]

Yeah, I think marionette isn't enabled by default for local builds of fennec but is required to run wpt. That looks like the kind of error I got before I realised I had to enable marionette explicitly. We could probably make the error message here more useful.

Comment 7

[James Graham [:jgraham]]

And should consider enabling marionette by default; I don't know why it isn't right now.

Comment 8

[Botond Ballo [:botond]]

I can confirm that rebuilding with "ac_add_options --enable-marionette" makes the test run successfully on the emulator - thanks!

I will leave this bug open to track either enabling marionette explicitly, or giving an error message that lets the user know that's what they need to do.

Comment 9

[Intermittent Failures Robot]

1 failures in 4850 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513695&startday=2019-11-04&endday=2019-11-10&tree=all