1575648 - Migrate webrender to community taskcluster deployment

Status: RESOLVED FIXED

(Taskcluster :: Operations and Service Requests, task)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

Make a plan to move this project to the new community deployment.

Notes:
repo's .taskcluster.yml is pretty simple
have a manually set up macos builder in toronto office, running generic-worker 11.x

So the immediate task is to upgrade that generic-worker in place to the latest version. Newer versions support deployments other than taskcluster.net, and if we end up with any other bugfixes required it will make it easier to deploy that fix.

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

derp, I gave my copy-pasting away!

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

I think that worker upgrade is in progress, or planned, but I can't actually find email or a bug confirming that..

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

All done:
https://tools.taskcluster.net/groups/IpWTnN5JQM-2e-cV9Zmeww/tasks/IpWTnN5JQM-2e-cV9Zmeww/runs/0/logs/public%2Flogs%2Flive_backing.log

[taskcluster 2019-08-29T21:44:51.697Z] Worker Type (localprovisioner/webrender-ci-osx) settings:
[taskcluster 2019-08-29T21:44:51.697Z]   {
[taskcluster 2019-08-29T21:44:51.697Z]     "config": {
[taskcluster 2019-08-29T21:44:51.697Z]       "deploymentId": ""
[taskcluster 2019-08-29T21:44:51.697Z]     },
[taskcluster 2019-08-29T21:44:51.697Z]     "generic-worker": {
[taskcluster 2019-08-29T21:44:51.697Z]       "engine": "simple",
[taskcluster 2019-08-29T21:44:51.697Z]       "go-arch": "amd64",
[taskcluster 2019-08-29T21:44:51.697Z]       "go-os": "darwin",
[taskcluster 2019-08-29T21:44:51.697Z]       "go-version": "go1.10.8",
[taskcluster 2019-08-29T21:44:51.697Z]       "release": "https://github.com/taskcluster/generic-worker/releases/tag/v15.1.4",
[taskcluster 2019-08-29T21:44:51.697Z]       "revision": "c407e45e3f019599005971b30993f29eb3c59b0d",
[taskcluster 2019-08-29T21:44:51.697Z]       "source": "https://github.com/taskcluster/generic-worker/commits/c407e45e3f019599005971b30993f29eb3c59b0d",
[taskcluster 2019-08-29T21:44:51.697Z]       "version": "15.1.4"
[taskcluster 2019-08-29T21:44:51.697Z]     }
[taskcluster 2019-08-29T21:44:51.697Z]   }

Thanks Jeff!

I think the next step will be for me to make a PR to upgrade .taskcluster.yml to version 1. Then not much to do until we have the new deployment up and running.

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

https://github.com/servo/webrender/pull/3744

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

Jeff, who should I look to review that PR? ^^

Comment 6

[Jeff Muizelaar [:jrmuizel]]

Ah sorry about dropping that. Can you submit it as phabricator review here? The upstream repo for webrender is m-c. We just sync the github repo from m-c.

Comment 7

[Dustin J. Mitchell [:dustin] (he/him)]

Attachment: Bug 1575648 - update webrender tc.yml to v1; r=jrmuizel

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/aca083b60c82
update webrender tc.yml to v1; r=jrmuizel

Comment 9

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/mozilla-central/rev/aca083b60c82

Comment 10

[Pete Moore [:pmoore][:pete]]

Attachment: GitHub Pull Request for community-tc-config

I've made inroads but this might not be entirely complete, but putting it up for review already to get feedback.

Comment 11

[Dustin J. Mitchell [:dustin] (he/him)]

PSA: The existing (https://taskcluster.net) deployment will be shut down a week from today, on November 9. After that point, any CI not migrated to the new community cluster will stop functioning. The TC team is ready and eager to help get everything migrated by that time, but the deadline is firm.

Apologies for failing to communicate this as broadly and loudly as necessary, and for the bugspam now.

Comment 12

[Pete Moore [:pmoore][:pete]]

Attachment: GitHub Pull Request for community-tc-config (part 2)

I missed the indexes!

This second PR allows webrender CI tasks (and kats's github fork) to submit indexes under the webrender project.

Comment 13

[Pete Moore [:pmoore][:pete]]

Attachment: GitHub Pull Request for webrender

This seems to do the trick.

Comment 14

[Dzmitry Malyshau [:kvark]]

Attachment: Bug 1575648 - Migrate from taskcluster.net to tools.community-tc.services.mozilla.com

[import_pr] From https://github.com/servo/webrender/pull/3793

Comment 15

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1e710184eb57
Migrate from taskcluster.net to tools.community-tc.services.mozilla.com r=jrmuizel

Comment 16

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/1e710184eb57

Comment 17

[Dustin J. Mitchell [:dustin] (he/him)]

I don't think we wanted this auto-closed. I still see results from the old deployment and not the new deployment at https://github.com/servo/webrender/commits/master

Comment 18

[Pete Moore [:pmoore][:pete]]

Attachment: Bug 1575648 - don't set RUSTFLAGS='--deny warnings' (temporary fix)

This change is a temporary fix to not set RUSTFLAGS='--deny warnings'
in order to unblock https://bugzil.la/1575648 (which is time-critical).
The longer term solution for this is https://bugzil.la/1564873.

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c61c05f37077
don't set RUSTFLAGS='--deny warnings' (temporary fix) r=nical

Comment 20

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/c61c05f37077

Comment 21

[Pete Moore [:pmoore][:pete]]

Success!

https://github.com/servo/webrender/pull/3794/commits/7971c991b9367fd16cd74186f0327e001b19e0ee
https://community-tc.services.mozilla.com/tasks/groups/VhdU44cQTTqx2jlQgzYYcw