1990567 - Use taskcluster package instead of REST API in taskgraph

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Comment 1

[Abhishek Madan[:abhishekmadan]]

Attachment: Bug 1990567 - Updated taskgraph to use taskcluster package instead of REST API.r?ahal

Comment 2

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - Vendor taskcluster-taskgraph v17.1.0, r?#taskgraph-reviewers

Comment 3

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - Use deb12-toolchain-build image for linux python toolchains, r?#firefox-build-system-reviewers

Taskgraph no longer supports Python 3.8. When we try to vendor the
latest version, the Python toolchain builds fail because they're using
Ubuntu 18.04 and have Python 3.8 installed.

Given both Python 3.8 and Ubuntu 18.04, upgrade to Ubuntu 22.04 which
comes with Python 3.10 by default.

Comment 4

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - [ci] Stop post processing base_ref / base_rev parameters in decision task, r?#taskgraph-reviewers

These internal functions have been removed from Taskgraph v17

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/3c7154d8304d
https://hg.mozilla.org/integration/autoland/rev/6dbb40f74ec9
Use deb12-toolchain-build image for linux python toolchains, r=firefox-build-system-reviewers,glandium
https://github.com/mozilla-firefox/firefox/commit/797144e673b1
https://hg.mozilla.org/integration/autoland/rev/e02f421b841c
[ci] Stop post processing base_ref / base_rev parameters in decision task, r=taskgraph-reviewers,jcristau

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/8e11aec37dcc
https://hg.mozilla.org/integration/autoland/rev/d96767e86cb2
Revert "Bug 1990567 - [ci] Stop post processing base_ref / base_rev parameters in decision task, r=taskgraph-reviewers,jcristau" for causing toolchain failures

Comment 7

[Sandor Molnar[:smolnar]]

Backed out for causing toolchain failures

Backout link: https://hg.mozilla.org/integration/autoland/rev/d96767e86cb2698742921cc6f1bb57096ec47b15

Push with failures

Failure log -> python3: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.35' not found (required by python3)

Comment 8

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - Update gecko_taskgraph / tryselect test expectations, r?#releng-reviewers

Taskgraph now uses the Taskcluster client library, which url encodes the
artifact path prior to making the request.

Comment 9

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - [ci] Temporarily monkeypatch taskcluster exceptions to be picklable, r?#taskgraph-reviewers

Comment 10

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - [ci] Catch TaskclusterRestFailure instead of requests.HTTPError, r?#taskgraph-reviewers

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/55086d47ce40
https://hg.mozilla.org/integration/autoland/rev/f8a880e6cdd6
[ci] Stop post processing base_ref / base_rev parameters in decision task, r=taskgraph-reviewers,jcristau
https://github.com/mozilla-firefox/firefox/commit/4063ac0be66a
https://hg.mozilla.org/integration/autoland/rev/24ecb12cbe23
Vendor taskcluster-taskgraph v17.1.0, r=taskgraph-reviewers,mach-reviewers,bhearsum
https://github.com/mozilla-firefox/firefox/commit/6376725ec8e5
https://hg.mozilla.org/integration/autoland/rev/6b43dc126c53
Updated taskgraph to use taskcluster package instead of REST API.r=ahal,taskgraph-reviewers,releng-reviewers
https://github.com/mozilla-firefox/firefox/commit/62219df14b15
https://hg.mozilla.org/integration/autoland/rev/10606abf4f05
Update gecko_taskgraph / tryselect test expectations, r=releng-reviewers,taskgraph-reviewers,jcristau
https://github.com/mozilla-firefox/firefox/commit/7ece99560bbf
https://hg.mozilla.org/integration/autoland/rev/7cb0eab318b8
[ci] Catch TaskclusterRestFailure in target_tasks.py, r=taskgraph-reviewers,bhearsum

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/674e9d235e1c
https://hg.mozilla.org/integration/autoland/rev/81990b4ce4e6
Revert "Bug 1990567 - [ci] Catch TaskclusterRestFailure in target_tasks.py, r=taskgraph-reviewers,bhearsum" because it affects Taskcluster actions.

Comment 13

[agoloman]

Backed out because it affects Taskcluster actions.

• Backout link
• Push with failures
• Failure Log

Comment 14

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - [ci] Remove unused 'use_proxy' flag in util/taskcluster.py, r?#taskgraph-reviewers

Comment 15

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1990567 - [ci] Fix pagination in `util.taskcluster.list_task_group_tasks`, r?#releng-reviewers

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/8a595ed171a6
https://hg.mozilla.org/integration/autoland/rev/b0a481a79e1f
[ci] Stop post processing base_ref / base_rev parameters in decision task, r=taskgraph-reviewers,jcristau
https://github.com/mozilla-firefox/firefox/commit/b42ac428c361
https://hg.mozilla.org/integration/autoland/rev/ae7d9f461b83
Vendor taskcluster-taskgraph v17.1.0, r=taskgraph-reviewers,mach-reviewers,bhearsum
https://github.com/mozilla-firefox/firefox/commit/fbdff5116e6b
https://hg.mozilla.org/integration/autoland/rev/12b6b99f5346
Updated taskgraph to use taskcluster package instead of REST API.r=ahal,taskgraph-reviewers,releng-reviewers
https://github.com/mozilla-firefox/firefox/commit/276ee4a6f5a3
https://hg.mozilla.org/integration/autoland/rev/5e038632de94
Update gecko_taskgraph / tryselect test expectations, r=releng-reviewers,taskgraph-reviewers,jcristau
https://github.com/mozilla-firefox/firefox/commit/b5fb864e953e
https://hg.mozilla.org/integration/autoland/rev/2041248c55f2
[ci] Remove unused 'use_proxy' flag in util/taskcluster.py, r=taskgraph-reviewers,releng-reviewers,bhearsum
https://github.com/mozilla-firefox/firefox/commit/0015485973e3
https://hg.mozilla.org/integration/autoland/rev/f8f210c7a81d
[ci] Catch TaskclusterRestFailure instead of requests.HTTPError, r=taskgraph-reviewers,bhearsum,releng-reviewers
https://github.com/mozilla-firefox/firefox/commit/71b23d56f1a8
https://hg.mozilla.org/integration/autoland/rev/05a7f41cd3fc
[ci] Fix pagination in `util.taskcluster.list_task_group_tasks`, r=releng-reviewers,taskgraph-reviewers,bhearsum,jcristau

Comment 17

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/b0a481a79e1f
https://hg.mozilla.org/mozilla-central/rev/ae7d9f461b83
https://hg.mozilla.org/mozilla-central/rev/12b6b99f5346
https://hg.mozilla.org/mozilla-central/rev/5e038632de94
https://hg.mozilla.org/mozilla-central/rev/2041248c55f2
https://hg.mozilla.org/mozilla-central/rev/f8f210c7a81d
https://hg.mozilla.org/mozilla-central/rev/05a7f41cd3fc