1628832 - [meta] KaiOS project branch

Status: REOPENED

(Release Engineering :: General, task, P1)

Description

[Eric Rahm [:erahm]]

For the KaiOS project we need to setup a project branch that will essentially be a mirror of KaiOS' public github repo. This bug will be used to track the various pieces related to setting that up including:

• Adding a project branch that is initially cloned from: https://github.com/kaiostech/gecko-b2g/tree/gonk
• Adding a scm group for KaiOS that will be used for syncing commits from github
• Work to setup builds and automation
• Possible work to setup automated syncing

Comment 1

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Remove obsolete `docker-worker:image` scopes; r?aki

Comment 2

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Move some firefox specific scriptworker and worker scopes to gecko trust domain; r?aki

Comment 3

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Add kaios-try repository; r?aki

Comment 4

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Add kaios repository; r?aki

Comment 5

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/treeherder/pull/6421

Comment 6

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [KaiOS] Substiture `trust-domain` in worker alias definitions; r?Callek

To help support KaiOS, we are running the kaios project branch in automation, with a
different trust domain. Allow configuring worker aliases using trust-domain, so
that they worker aliases do not need to be adjusted on that branch.

Comment 7

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Remove some obsolete routes from the decision task; r?Callek

Comment 8

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [KaiOS] Factor out trust-domain in `.taskcluster.yml`; r?Callek

To help support KaiOS, we are running the kaios project branch in automation, with a
different trust domain. Factor out the usages of trust-domain in .taskcluster.yml
to make it easy for the kaios branch to merge changes from mozilla-central.

Comment 9

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [KaiOS] Add kaios specific taskgraph paramters and target tasks; r?Callek

Comment 10

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [KaiOS] Include docker-images in target graph via `always_target`; r?Callek

Docker images are included in the target graph so that they are available for
morphs, which happen late in task graph generation. However, we can also handle
this by setting the always_target attribute to true.

Switching to using always_target allows making images that are not built
automatically. This can be used on the kaios branch to disable images (such as
those used in the release process) that are not needed there.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7fd0677c3245
[KaiOS] Substiture `trust-domain` in worker alias definitions; r=Callek
https://hg.mozilla.org/integration/autoland/rev/18dd53db31b8
Remove some obsolete routes from the decision task; r=Callek
https://hg.mozilla.org/integration/autoland/rev/aa8830518651
[KaiOS] Factor out trust-domain in `.taskcluster.yml`; r=Callek
https://hg.mozilla.org/integration/autoland/rev/6166a282f490
[KaiOS] Add kaios specific taskgraph paramters and target tasks; r=Callek

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/06a5a172632c
[KaiOS] Substiture `trust-domain` in worker alias definitions; r=Callek
https://hg.mozilla.org/mozilla-central/rev/e28ac9204ed8
Remove some obsolete routes from the decision task; r=Callek
https://hg.mozilla.org/mozilla-central/rev/5fa6bffbd5c6
[KaiOS] Factor out trust-domain in `.taskcluster.yml`; r=Callek
https://hg.mozilla.org/mozilla-central/rev/a77ca5bd6b7c
[KaiOS] Add kaios specific taskgraph paramters and target tasks; r=Callek

Comment 13

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/06a5a172632c
https://hg.mozilla.org/mozilla-central/rev/e28ac9204ed8
https://hg.mozilla.org/mozilla-central/rev/5fa6bffbd5c6
https://hg.mozilla.org/mozilla-central/rev/a77ca5bd6b7c

Comment 14

[Sebastian Hengst [:aryx] (needinfo on intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/7fd0677c3245
https://hg.mozilla.org/mozilla-central/rev/18dd53db31b8
https://hg.mozilla.org/mozilla-central/rev/aa8830518651
https://hg.mozilla.org/mozilla-central/rev/6166a282f490

Comment 15

[Kai-Zhen Li [:seinlin][:kli]]

Hi Tom, the patch and the related change are in the project, could you help to verify it? Thanks!

[1] https://d3kxowhw4s8amj.cloudfront.net/file/data/5drgsf7jeunsr4lsdvlq/PHID-FILE-jzzxlofzuoaob6uw4jc3/D75393.diff

Comment 16

[Tom Prince [:tomprince]]

Attachment: mozautomation: Add KaiOS branches. (bug 1628832) r?sheehan

Comment 17

[Tom Prince [:tomprince]]

It looks like it is working: https://treeherder.mozilla.org/#/jobs?repo=kaios

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/hgcustom/version-control-tools/rev/2d3d6c968043
mozautomation: Add KaiOS branches. r=sheehan

Comment 19

[Tom Prince [:tomprince]]

Attachment: [taskgraph] Set taskcluster trust-domain to kaios.

Comment 20

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Always build toolchains used by `mach bootstrap` on pushes to `kaios` project.

Comment 21

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Don't try to run tasks on Windows or macOS workers.

There are no Windows or macOS workers provisioned for kaios, so don't try to
run tasks on those platforms.

Comment 22

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Push to kaios-try by default; r=ahal

Comment 23

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [taskgraph] Use a transform to limit non-linux tasks on kaios; r=Callek

Comment 24

[Gabriele Svelto [:gsvelto]]

D75994 and D75995 have landed on the kaios branch yesterday via GitHub:

https://github.com/kaiostech/gecko-b2g/commit/9329e1ff24ddfa2fd0d59414a793a2cc8c54ad37
https://github.com/kaiostech/gecko-b2g/commit/809c7059cbf154cdda179889540ede7594bdab8d

Comment 25

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: [taskgraph] Run b2g toolchains on kaios branch.

Comment 26

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Make secret scope generic over trust domain; r?Callek

Comment 27

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7b8c4f32cdde
Make secret scope generic over trust domain; r=Callek

Comment 28

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/7b8c4f32cdde

Comment 29

[Tom Prince [:tomprince]]

Attachment: Bug 1628832: Add kaios `t-linux-metal` workers; r?callek

Comment 30

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/8c6f5f9f3053
Add kaios `t-linux-metal` workers; r=Callek