1932631 - `./mach wpt` does not run tests on an Android real device

Status: NEW

(GeckoView :: General, task, P5)

Description

[Olivia Hall [:olivia]]

When trying to run ./mach wpt webcodecs:

• On an emulated device, the test loads and runs as expected.

• On a real physical device, the logs get stuck at:
  0:48.48 adb INFO Setting run_as_package to org.mozilla.geckoview.test_runner

./mach geckoview-junit runs as expected on a real device.
Device is an Android 14 Pixel 4a.

Comment 1

[Olivia Hall [:olivia]]

Attachment: startup.log

Comment 2

[Olivia Hall [:olivia]]

Attachment: startup.log

Problems listed at file:///Users/olivia/Repos/gecko/obj-aarch64-unknown-linux-android/gradle/build/reports/problems/problems-report.html were build lint warnings and the like.

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:owlish, could you have a look please?

For more information, please visit BugBot documentation.

Comment 4

[Olivia Hall [:olivia]]

Have some follow-up information :adhingra discovered:

Paraphrasing:
It looks like device serial isn't passed. A workaround is to paste the id from adb devices here.

The emulator was hardcoded here.

--device-serial may also be used.

Comment 5

[Benjamin De Kosnik [:bdekoz]]

This is not sufficient.

./mach wpt --package-name org.mozilla.fenix.debug --device-serial 39271FDJH00A7H testing/web-platform/tests/resource-timing/initiator-type/input.html

This harness has never worked with actual android devices.

Comment 6

[Nick Alexander :nalexander [he/him]]

Do we know if there's a conceptual blocker, i.e., not just misconfiguration; or do we know that there is no conceptual blocker (perhaps because :olivia has made it work on a device); or do we not know one way of the other?

Comment 7

[Olivia Hall [:olivia]]

Thanks for taking a look!

It sounded like :padenot managed a workaround to get it to run on a real device (based on this Slack thread for more context). :jgraham had some more context too. There didn't seem to be a specific reason wpt tests should not run on real devices, more just that they hadn't been fully plumbed in.

(I'm not sure about org.mozilla.fenix.debug as mentioned in Comment 5, though. I was under the impression that in the first case that they were also running org.mozilla.geckoview.test_runner.)