1718341 - Generate Android Emulator from TL task

Status: RESOLVED FIXED

(GeckoView :: General, enhancement, P1)

Description

[[ex-Mozilla] Agi Sferro | :agi]

Right now the Android Emulator is stored in a tooltool archive, which makes it hard to update as the knowledge of how the emulator is packaged is not transparent in the codebase.

Instead, we should create a declarative TL job that packages the emulator so that it can be easily updated and modified.

Comment 1

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Rename androidx86_7_0.py to android-x86_64.

Comment 2

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Rename arm-4.3 -> arm

Comment 3

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Generate Android AVD in TL job instead of using tooltool

Tooltool images are hard to update because we don't provide a script to
generate the image and documentation is often inaccurate.

This patch makes it so we generate the AVD in the android-sdk TL job instead.

Comment 4

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Use generated emulator when running WR Android jobs.

Comment 5

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Run instrumented build on x86_64.

The ARM emulator images have very poor support and haven't been updated for a
long time.

Normally x86_64 images need KVM acceleration which is not available on build
machines (see Bug 1545497). We can work around this by starting the emulator
with the command line |--no-accel|.

Comment 6

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Initialize XVFB during SDK packaging.

Comment 7

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Prewarm AVD before packaging

The very first time an Android AVD starts it runs some one time jobs to
properly set up the AVD.

To avoid running the setup every time we run tests in automation, we can boot
the AVD before packaging it so that the testing jobs can use a "prewarmed" AVD
instead.

Comment 8

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Update Android cmdtools to 4.0.

The SDK Tools version we're currently using is deprecated and was last released
in 2017. It's time for an upgrade!

Comment 9

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Download Android AVD from TL job artifact.

Comment 10

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Remove redundant override in MobileAndroidBootstrapper.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1c8844157b8d
Rename androidx86_7_0.py to android-x86_64. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/ebc0d5d4f537
Rename arm-4.3 -> arm r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/2b17603c5e65
Run instrumented build on x86_64. r=aklotz,glandium
https://hg.mozilla.org/integration/autoland/rev/3920b27acecb
Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/03266cea345d
Use generated emulator when running WR Android jobs. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/31dfce45985f
Initialize XVFB during SDK packaging. r=glandium
https://hg.mozilla.org/integration/autoland/rev/2bd647754780
Prewarm AVD before packaging r=nalexander
https://hg.mozilla.org/integration/autoland/rev/d9462c727c8f
Remove redundant override in MobileAndroidBootstrapper. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/e82e752b8f44
Update Android cmdtools to 4.0. r=nalexander,glandium
https://hg.mozilla.org/integration/autoland/rev/e5bd150a58b2
Download Android AVD from TL job artifact. r=nalexander

Comment 12

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/29681 for changes under testing/web-platform/tests

Comment 13

[Sandor Molnar[:smolnar]]

Backed out for causing wrench bustages

Backout link: https://hg.mozilla.org/integration/autoland/rev/1c2630a2b25409047650d06f56d9d3bd7b8702b3

Push with failures

Failure log

Comment 14

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR was closed without merging

Comment 15

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e7bf6deac270
Rename androidx86_7_0.py to android-x86_64. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/f33b120a77d0
Rename arm-4.3 -> arm r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/7723d3a9ba7f
Run instrumented build on x86_64. r=aklotz,glandium
https://hg.mozilla.org/integration/autoland/rev/8afb8fcd0dc3
Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/b6c4c82d3efc
Use generated emulator when running WR Android jobs. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/8ec277361e46
Initialize XVFB during SDK packaging. r=glandium
https://hg.mozilla.org/integration/autoland/rev/2b47cc469477
Prewarm AVD before packaging r=nalexander
https://hg.mozilla.org/integration/autoland/rev/09d3d3e4ce7d
Remove redundant override in MobileAndroidBootstrapper. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/cf443dddb5f5
Update Android cmdtools to 4.0. r=nalexander,glandium
https://hg.mozilla.org/integration/autoland/rev/f072adb45b85
Download Android AVD from TL job artifact. r=nalexander

Comment 16

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1718341 - Enable keyboard in Android AVDs.

Just noticed that the emulators don't have the keyboard enabled, which makes it
very annoying to test stuff locally.

Comment 17

[Atila Butkovits]

Backed out for causing android build bustages.

Backout link: https://hg.mozilla.org/integration/autoland/rev/6238e92b6f4172905e58930866ffe4970dd000fe

Push with failures: https://treeherder.mozilla.org/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&revision=f072adb45b8546fed63ba1be43de2ca22229268b&selectedTaskRun=O1_SX-jiTACS6j_8gqbo0w.0

Failure log: https://treeherder.mozilla.org/logviewer?job_id=345485382&repo=autoland&lineNumber=25707
https://treeherder.mozilla.org/logviewer?job_id=345486020&repo=autoland&lineNumber=43588

Comment 18

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR was closed without merging

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2e16fa5f0a1f
Rename androidx86_7_0.py to android-x86_64. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/38d622f60fa5
Rename arm-4.3 -> arm r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/176238f92cfe
Run instrumented build on x86_64. r=aklotz,glandium
https://hg.mozilla.org/integration/autoland/rev/3bd0e376de51
Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/74cfe6df218b
Use generated emulator when running WR Android jobs. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/5e76806752c8
Initialize XVFB during SDK packaging. r=glandium
https://hg.mozilla.org/integration/autoland/rev/c7de56a1f886
Prewarm AVD before packaging r=nalexander
https://hg.mozilla.org/integration/autoland/rev/31a57851c6d1
Remove redundant override in MobileAndroidBootstrapper. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/a87639f2921b
Update Android cmdtools to 4.0. r=nalexander,glandium
https://hg.mozilla.org/integration/autoland/rev/a15b3b87d71e
Download Android AVD from TL job artifact. r=nalexander

Comment 20

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

This got backed out together with bug 1709640 - see that bug for more information:

https://hg.mozilla.org/integration/autoland/rev/27f30c002564d083369f5149413ad2f6c43000f0

Comment 21

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR was closed without merging

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e5f7e5f1bf6f
Rename androidx86_7_0.py to android-x86_64. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/b7a481fdfc02
Rename arm-4.3 -> arm r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/59beb0677c0f
Run instrumented build on x86_64. r=aklotz,glandium
https://hg.mozilla.org/integration/autoland/rev/29d7955f3d67
Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
https://hg.mozilla.org/integration/autoland/rev/4beb405194e3
Use generated emulator when running WR Android jobs. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/d4f446f77445
Initialize XVFB during SDK packaging. r=glandium
https://hg.mozilla.org/integration/autoland/rev/278f19a3843c
Prewarm AVD before packaging r=nalexander
https://hg.mozilla.org/integration/autoland/rev/602cbe55764d
Remove redundant override in MobileAndroidBootstrapper. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/34c210663337
Update Android cmdtools to 4.0. r=nalexander,glandium
https://hg.mozilla.org/integration/autoland/rev/f970d5a5fb95
Download Android AVD from TL job artifact. r=nalexander

Comment 23

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/e5f7e5f1bf6f
https://hg.mozilla.org/mozilla-central/rev/b7a481fdfc02
https://hg.mozilla.org/mozilla-central/rev/59beb0677c0f
https://hg.mozilla.org/mozilla-central/rev/29d7955f3d67
https://hg.mozilla.org/mozilla-central/rev/4beb405194e3
https://hg.mozilla.org/mozilla-central/rev/d4f446f77445
https://hg.mozilla.org/mozilla-central/rev/278f19a3843c
https://hg.mozilla.org/mozilla-central/rev/602cbe55764d
https://hg.mozilla.org/mozilla-central/rev/34c210663337
https://hg.mozilla.org/mozilla-central/rev/f970d5a5fb95

Comment 24

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cb03ecaab939
Enable keyboard in Android AVDs. r=nalexander

Comment 25

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/cb03ecaab939

Comment 26

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot