1270544 - Migrate Android tests to TaskCluster

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Comment 1

[Geoff Brown [:gbrown]]

I ran into some issues with assumptions about paths to executables - easily addressed.

Tooltool downloads also gave me trouble, particularly the sdk downloads, which are internal. Needed to ensure:
 - payload.features.relengapiProxy = true
 - scopes: 'docker-worker:relengapi-proxy:tooltool.download.internal'
 - "tooltool_servers": ['http://relengapi/tooltool/']

In addition, :dustin found that he needed to add the relengapi token to the desktop-test workerType. That seems to be working now.

https://treeherder.mozilla.org/#/jobs?repo=try&revision=a4f398fdfb69

Comment 2

[Geoff Brown [:gbrown]]

Attachment: update some android build settings

Inherit the more reasonable maxRunTime of 7200 and cleanup the build locations to enable tests.

Comment 3

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/0ffc66933c30

Comment 4

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/0ffc66933c30

Comment 5

[Geoff Brown [:gbrown]]

There is more work to do here, but as a proof-of-concept, I am quite pleased with these results:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=37bacda767db&exclusion_profile=false
https://treeherder.mozilla.org/#/jobs?repo=try&revision=fd227451707e&exclusion_profile=false

Comment 6

[Geoff Brown [:gbrown]]

Slight tweaks to maxRunTime and workerType:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=54aee925b2a6&exclusion_profile=false

Comment 7

[Geoff Brown [:gbrown]]

Attachment: wip - add android test tasks

Work in progress: Run Android 4.3 opt tests on TC with same chunking as buildbot.

Comment 8

[Geoff Brown [:gbrown]]

Attachment: wip - mozharness changes for tc android tests

Work in progress - Additional changes to mozharness needed for Android-on-TC.

Comment 9

[Geoff Brown [:gbrown]]

This is quite functional now, for Android 4.3 opt. Still to do:

 - add new gpu and clipboard tests
 - remove existing hostutils tooltool hacks: the hostutils in tooltool is in a different format than the "tegra" host utils used by buildbot. It would be nice if we could get all hostutils users (buildbot, taskcluster, mach) using the same host utils.
 - try to find a way to modify TC test chunks without impacting buildbot (otherwise, land, go to Tier 1, retire buildbot jobs, then modify TC test chunks as desired)
 - get tests to appear in treeherder beside "Android 4.3"; this might be resolved with bug 1274610
 - get Android API 15 opt build unhidden (bug 1276069?)
 - verify crash reporting and robocop screenshots (hangs verified already)
 - continue with Android 4.3 debug build + tests

Comment 10

[Geoff Brown [:gbrown]]

Comment on attachment 8757410 [details] [diff] [review]
wip - add android test tasks

Similar changes landed in other bugs.

Comment 11

[Geoff Brown [:gbrown]]

Comment on attachment 8757416 [details] [diff] [review]
wip - mozharness changes for tc android tests

Similar changes landed in other bugs.

Comment 12

[Geoff Brown [:gbrown]]

Taskcluster Android 4.3 debug and Android x86 4.2 opt builds and tests are tier 1 on trunk now (and have been for a while). TC Android 4.3 opt is running fine but remains at tier 2 for the time being.