1596775 - Migrate OS symbols hooks, secrets, and roles to Community TC

Status: RESOLVED FIXED

(Taskcluster :: Operations and Service Requests, task)

Description

[Marco Castelluccio [:marco]]

They could wait to be migrated, but now enough time has passed that we need them again.

The hooks were:

• https://tools.taskcluster.net/hooks/project-socorro/fetch-mac-update-symbols
• https://tools.taskcluster.net/hooks/project-socorro/fetch-win32-symbols

The roles were:

• https://tools.taskcluster.net/auth/roles/hook-id%3Aproject-socorro%2Ffetch-mac-update-symbols
• https://tools.taskcluster.net/auth/roles/hook-id%3Aproject-socorro%2Ffetch-win32-symbols

The secret was:

• https://tools.taskcluster.net/secrets/project%2Fsocorro%2Fsymbol-upload

Comment 1

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Import scripts for downloading macOS system symbols;

Import the code from
https://github.com/marco-c/breakpad-mac-update-symbols/
and
https://github.com/marco-c/breakpad-scrape-system-symbols

Comment 2

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Import scripts for uploading windows system symbols;

This imports the code from
https://github.com/marco-c/breakpad-win-update-symbols

Comment 3

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Add tasks from extraction system symbols;

Comment 4

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Run black on imported code;

Comment 5

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Cleanup flake8 errors in system-symbol code;

Comment 6

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Cleanup shellcheck errors on imported code;

Comment 7

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Update license headers;

parse_pbzx.py appears to be from
https://gist.github.com/pudquick/ac29c8c19432f2d200d4 which does not have a
liscense.

Comment 8

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Add some error handling;

Comment 9

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Add tasks to upload symbols to server;

Comment 10

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Run system-symbols task daily;

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/328e5280b0e4
Import scripts for downloading macOS system symbols; r=marco
https://hg.mozilla.org/integration/autoland/rev/584eada208ec
Import scripts for uploading windows system symbols; r=marco
https://hg.mozilla.org/integration/autoland/rev/d5ffaf8e6d4e
Add tasks from extraction system symbols; r=glandium,marco
https://hg.mozilla.org/integration/autoland/rev/7779e80d8e1d
Run black on imported code; r=ahal
https://hg.mozilla.org/integration/autoland/rev/31b513e5b2df
Cleanup flake8 errors in system-symbol code; r=ahal
https://hg.mozilla.org/integration/autoland/rev/fe0662f71415
Cleanup shellcheck errors on imported code; r=ahal
https://hg.mozilla.org/integration/autoland/rev/8c5eab80ed85
Update license headers; r=glandium
https://hg.mozilla.org/integration/autoland/rev/d3487cd72451
Add some error handling; r=glandium,marco
https://hg.mozilla.org/integration/autoland/rev/4a64307eaf23
Add tasks to upload symbols to server; r=glandium,marco
https://hg.mozilla.org/integration/autoland/rev/e20a4135d8dc
Run system-symbols task daily; r=glandium

Comment 12

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: Add flake8 skip for python3.8;

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2bfd69c03284
Add flake8 skip for python3.8;

Comment 14

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/328e5280b0e4
https://hg.mozilla.org/mozilla-central/rev/584eada208ec
https://hg.mozilla.org/mozilla-central/rev/d5ffaf8e6d4e
https://hg.mozilla.org/mozilla-central/rev/7779e80d8e1d
https://hg.mozilla.org/mozilla-central/rev/31b513e5b2df
https://hg.mozilla.org/mozilla-central/rev/fe0662f71415
https://hg.mozilla.org/mozilla-central/rev/8c5eab80ed85
https://hg.mozilla.org/mozilla-central/rev/d3487cd72451
https://hg.mozilla.org/mozilla-central/rev/4a64307eaf23
https://hg.mozilla.org/mozilla-central/rev/e20a4135d8dc
https://hg.mozilla.org/mozilla-central/rev/2bfd69c03284

Comment 15

[Tom Prince [:tomprince]]

Attachment: Bug 1596775: [taskgraph] Don't require any attributes when copying them;

copy_attributes_from_dependent_task was originally used for tasks downstream
so required build_type and build_platform, but the function is useful
enough, that it should not require anything.

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/5343dd9f67f3
[taskgraph] Don't require any attributes when copying them; r=Callek a=tomprince

Comment 17

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/5343dd9f67f3