1522997 - [meta] Run taskcluster generic-worker on windows/aarch64

Status: RESOLVED FIXED

(Core :: General, enhancement)

Description

[Edwin Takahashi (:egao | infrequent contributor)]

Find out a way, and document a way to run Taskcluster generic-worker on aarch64.

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

Sorry for the juggling of dependencies. Haven't done this before, simply trying to put it sufficiently low in the tree that it doesn't affect/cc everyone else.

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

I have got Taskcluster generic-worker running on aarch64.

Process

Prerequisites

• win10/aarch64 hardware must be taken out of Windows S mode
• User Account Control is disabled
• Set up "Remote Desktop Users" on aarch64 machine: net localgroup "Remote Desktop Users" /add
  • my laptop did not have the group Remote Desktop Users added, hence this was a required step. YMMV.
• Request Taskcluster scope assume:project:taskcluster:generic-worker-tester
  • have an account used to authenticate to Taskcluster
• Download and unzip NSSM to a directory in C:\; should look something like C:\nssm-2.24\
• disable Windows Firewall

Optional Requirements

• Download and install Mozilla-Build 2.0.0, available from here
• Download mozharness and extract to C:\mozilla-build\; the structure should be C:\mozilla-build\mozharness\...

Steps

1. download the current 386 release of generic-worker-windows-386.exe from taskcluster generic-worker releases.
2. download the latest 386 version of livelog.exe and taskcluster-proxy.exe.
3. create new directory C:\generic-worker
4. move the three executable files under the new directory.
5. rename generic-worker-windows-386.exe to generic-worker.exe.
6. generate two signing keys:

generic-worker new-openpgp-keypair --file <unique_file_name>
generic-worker new-ed25519-keypair --file <unique_file_name>

7. create generic-worker.config and include the following:

{
    "accessToken":                "<access token tied to taskcluster>",
    "clientId":                   "<client ID tied to taskcluster>",
    "ed25519SigningKeyLocation":  "<file location you wrote ed25519 private key in step 6>",
    "livelogSecret":              "<any text>",
    "openpgpSigningKeyLocation":  "<file location you wrote gpg private key kn step 6>",
    "provisionerId":              "test-provisioner",
    "publicIP":                   "<ideally an IP address of one of your network interfaces>",
    "rootURL":                    "https://taskcluster.net",
    "workerGroup":                "test-worker-group",
    "workerId":                   "test-worker-id",
    "workerType":                 "<a unique string that only you will use for your test worker(s)>"
}

8. launch cmd.exe with Administrator rights
9. cd c:\generic-worker
10. generic-worker.exe install service --config generic-worker.config --nssm c:\nssm-2.24\win32\nssm.exe
11. reboot once installation completes
12. launch cmd.exe with Administrator rights
13. sc query "Generic Worker" - ensure the status is RUNNING

The above should get the laptop in a state where generic-worker is running and is ready to accept tasks. Once in this state, go to https://tools.taskcluster.net and create a task with provisionerId and workerType that match the content of generic-worker.config. An example is below:

provisionerId: test-provisioner
workerType: aarch64windowsedwin
retries: 5
created: '2019-01-31T17:47:35.526Z'
deadline: '2019-01-31T20:47:35.526Z'
expires: '2020-01-31T20:47:35.526Z'
scopes: []
taskGroupId: YUosbKEtSs2GZGLenPTPpw
dependencies:
  - DdbhnS_zRmiRXF5yh8UBiA
payload:
  maxRunTime: 120
  command:
    - dir
    - echo hi
metadata:
  owner: [e-mail]
  source: >-
    https://hg.mozilla.org/mozilla-central/file/6b7bc40023111979a4755dfeca82629c9c022cd5/taskcluster/ci/test
  description: test run
  name: test run

Comment 3

[Edwin Takahashi (:egao | infrequent contributor)]

Taskcluster Generic-Worker was able to run on Windows 64 ARM reference laptop, accept tasks and execute them.

This task records the successful run.

Now moving to invoke a CI test on the reference laptop.

Comment 4

[Edwin Takahashi (:egao | infrequent contributor)]

Marking this as complete.

This is a successful taskcluster generic-worker run that implements the entire process:

• try push
• build win10/aarch64
• run tests using build artifact
• report results to taskcluster

Comment 5

[(Away)]

(In reply to Edwin Gao (:egao) from comment #4)

Marking this as complete.

This is a
successful taskcluster generic-worker run that implements the entire process:

• try push
• build win10/aarch64
• run tests using build artifact
• report results to taskcluster

This is great! Just to confirm my understanding, there's still more to come in terms of additional test suites, right? Is it fair to expect that eventually we'll have a full taskcluster run where it's possible to see all of the failing tests from one place? (And be able to do the runs again over time and watch them green up?)

Comment 6

[Edwin Takahashi (:egao | infrequent contributor)]

(In reply to David Major [:dmajor] from comment #5)

(In reply to Edwin Gao (:egao) from comment #4)

Marking this as complete.

This is a
successful taskcluster generic-worker run that implements the entire process:

• try push
• build win10/aarch64
• run tests using build artifact
• report results to taskcluster

This is great! Just to confirm my understanding, there's still more to come in terms of additional test suites, right? Is it fair to expect that eventually we'll have a full taskcluster run where it's possible to see all of the failing tests from one place? (And be able to do the runs again over time and watch them green up?)

Yes, jmaher, gbrown and I only managed to run xpcshell suite so far - we have only 1 machine executing tasks, so it is rather slow. This is the Treeherder view of Taskcluster tasks.

From Treeherder, I've checked the following functionality and it seems to work:

• schedule new jobs via Treeherder
• view results

Comment 7

[(Away)]

(In reply to Edwin Gao (:egao) from comment #6)

[This](https://treeherder.mozilla.org/#/
jobs?repo=try&revision=7f2edbc029097dc7ca3c14f2ae488e4d7275d147) is the
Treeherder view of Taskcluster tasks.

\o/ Thanks!

Comment 8

[Anthony Jones (:ajones, :kentuckyfriedtakahe, :k17e)]

There would be value in getting the most basic tests working, sufficient to prevent something like bug 1525588 making it to m-c.