1519477 - |mach reftest| hangs when trying to run reftest on Fennec device build (poor reporting of network setup problems)

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: Testing, defect, P1)

Description

[Botond Ballo [:botond]]

Attachment: Output from |mach reftest|

When I try to run |mach reftest| to run a reftest on a Fennec device build, the browser opens on the device, but then the test hangs. The last line of output before the hang is:

REFTEST ERROR | EXCEPTION: [Exception... "Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIHttpChannel.responseStatus]" nsresult: "0x80040111 (NS_ERROR_NOT_AVAILABLE)" location: "JS frame :: resource://reftest/manifest.jsm :: ReadManifest :: line 55" data: no]

I attached the entire output.

Comment 1

[Geoff Brown [:gbrown]]

Attachment: for comparison: same command is okay on emulator (x86 build)

Comment 2

[Geoff Brown [:gbrown]]

Logcat from the device might be helpful.

Is it possible the device is not on wifi, or otherwise cannot make a network connection back to the host?

Comment 3

[Botond Ballo [:botond]]

(In reply to Geoff Brown [:gbrown] from comment #2)

Is it possible the device is not on wifi, or otherwise cannot make a network connection back to the host?

Argh, sorry. I keep forgetting the devices need to be on the same network. That was indeed the problem.

I'll leave it up to you if you'd like to use this report to track giving a clearer error about this, or just close it.

Comment 4

[Geoff Brown [:gbrown]]

No worries.

I'll see if I can improve the error.

Comment 5

[Geoff Brown [:gbrown]]

Attachment: warn if unable to ping device from host, in mach, via verify_android_device

I think this fits in well with existing verify_android_device() functionality: just as most mach test commands want to ensure that a device is connected, that the test app is installed, that host-utils are available, let's also check the network.

Checking the network is unlikely to be useful when using an emulator -- let's not try to when the device-serial looks like an emulator.

Actually checking the network is potentially problematic. I'd kind-of like to ping the host from the device, but I worry about the availability of ping on Android, and whether it might vary in behavior across Android OS versions. Rather than add that dependency, I'm just pinging the device from the host, believing that usually, if the host can see the device, the device should be able to see the host.

If the device IP cannot be obtained or ping fails, mach reports a WARNING but doesn't fail. My reasoning here is that if the network is actually problematic, tests will fail quickly and the curious will look through scrollback and find the WARNINGs; on the other hand, if the network is good enough for tests to run but these new checks are failing inappropriately, the warnings won't get in anyone's way.

Comment 6

[Bob Clary [:bc] (inactive)]

Comment on attachment 9036752 [details] [diff] [review]
warn if unable to ping device from host, in mach, via verify_android_device

Review of attachment 9036752 [details] [diff] [review]:
-----------------------------------------------------------------

r+. lgtm though if we don't need the str(addr) let's remove it.

::: testing/mozbase/mozrunner/mozrunner/devices/android_device.py
@@ +320,5 @@
> +                if not addr:
> +                    _log_warning("unable to get Android device's IP address!")
> +                    _log_warning("tests may fail without network connectivity to the device!")
> +                else:
> +                    _log_info("Android device's IP address: %s" % str(addr))

is str(...) required?

Comment 7

[Geoff Brown [:gbrown]]

str() is not required - will tidy. Thanks.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/4c08e7df7398
Try to detect networking connectivity problems before running local tests on android; r=bc

Comment 9

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/4c08e7df7398