1536568 - Run Android builds in GCP at tier 3

Status: RESOLVED FIXED

(Taskcluster :: Workers, enhancement)

Description

[Chris Cooper [:coop] (he/him)]

We haven't tried Android builds in GCE yet. Despite using separate worker pools in AWS, I don't believe (and will verify) that the underlying instances are identical to those we use for Linux builds (bug 1525094).

Comment 1

[Chris Cooper [:coop] (he/him)]

Android PGO adds another wrinkle here (bug 1535132).

Comment 2

[Chris Cooper [:coop] (he/him)]

catlee did some investigation and we can run these on the same worker type as for linux. See bug 1539903 for details.

Comment 3

[Chris Cooper [:coop] (he/him)]

Further good news, Bob already ran Android builds once as part of the final phase of the Linux testing:

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=e16ce1eed7cd5546dd0bb45bcec2467ec68fcc2c

Comment 4

[Chris Cooper [:coop] (he/him)]

(In reply to Chris Cooper [:coop] pronoun: he from comment #3)

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=e16ce1eed7cd5546dd0bb45bcec2467ec68fcc2c

The build timings aren't directly comparable because they all rely on sccache, but all the builds do pass.

I will file follow-up bugs to:

1. Compare the test failure profile builds generated in GCE vs those generated in AWS
2. Get sccache setup in GCE, per https://bugzilla.mozilla.org/show_bug.cgi?id=1529951#c11

Comment 5

[Chris Cooper [:coop] (he/him)]

(In reply to Chris Cooper [:coop] pronoun: he from comment #4)

1. Compare the test failure profile builds generated in GCE vs those generated in AWS

https://bugzilla.mozilla.org/show_bug.cgi?id=1539962

2. Get sccache setup in GCE, per https://bugzilla.mozilla.org/show_bug.cgi?id=1529951#c11

https://bugzilla.mozilla.org/show_bug.cgi?id=1539961

Comment 6

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: run android builds in gcp at tier 3

this change adds support for parallel gcp builds for the following android build configurations:

• android-api-16
  • opt
  • debug
• android-x86
  • opt
• android-x86_64
  • opt
  • debug
• android-aarch64
  • opt
  • debug

implementation notes:

• this patch mostly mirrors the equivalent windows-on-gcp patch at: https://phabricator.services.mozilla.com/D24865
• gcp builds are triggered with a treeherder tier 3 flag so that they are only displayed in the treeherder ui when the user has a tier 3 flag set.
• gcp builds use a th build symbol of "Bg" to make them easy to differentiate from ec2 builds in the treeherder ui.
• gcp builds use a perfherder "gcp" flag to make them easier to differentiate from ec2 builds in the perfherder ui.

Comment 7

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=599a8b5cfd66e5fbf0349365345c90ee641ae872

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0fe8750efcd4
run android builds in gcp at tier 3 r=coop,pmoore

Comment 9

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/0fe8750efcd4