1566423 - Android 7.0 TV mochitests run against the Fennec APK instead of TestRunnerActivity

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[Rob Wu [:robwu]]

According to the first comment at bug 1563281, Android 7.0 tests generally run with GeckoView.

Apparently, this is not the case for TV tests, and several days were wasted on debugging a try-only test failure (because the issue happened with Fennec only, and the expectation was that the tests only ran on GeckoView).
The lack of TV test coverage reduces the likelihood of catching common causes for intermittent failures at an early stage, so hopefully TV is going to be enabled for GeckoView soon.

Example of TV with unexpected results: https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=256704266&revision=badc5136d3cfa1c866713fd1648109f7ad664216

Example of mochitest that runs as expected: https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=256704268&revision=badc5136d3cfa1c866713fd1648109f7ad664216

Comment 1

[Rob Wu [:robwu]]

I think that something needs to be added at https://searchfox.org/mozilla-central/rev/07f7390618692fa4f2a674a96b9b677df3a13450/taskcluster/ci/test/misc.yml#78 , but you probably know better. Could you take a look?

Comment 3

[Geoff Brown [:gbrown]]

It is easy to change Android 7.0 TV to run against geckoview, but Android 7.0 xpcshell still runs against fennec, and TV verifies xpcshell tests as well as mochitest and reftest. Let's see if we can move bug 1553225 along soon so that all of Android 7.0 can run against geckoview.

Comment 4

[Geoff Brown [:gbrown]]

Attachment: Bug 1566423 - Run Android 7.0 TV against geckoview; r=jmaher

As soon as xpcshell is switched over to geckoview, we can do the same for android TV.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/43f551ed9167
Run Android 7.0 TV against geckoview; r=jmaher

Comment 6

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/43f551ed9167