1831682 - mach-vendor: Download release artifacts from Github instead of git-archive exports

Status: RESOLVED FIXED

(Developer Infrastructure :: Mach Vendor & Updatebot, enhancement)

Description

[Rob Lemley [:rjl]]

Update mach vendor to be able to use release artifacts from Github projects as an alternative to the git archive tar files currently supported.

Use case:
Thunderbird vendors librnp from https://github.com/rnpgp/rnp. Version 0.17.0 added a Git submodule to the repository: https://github.com/rnpgp/sexp. It's a library maintained by the same organization and was recently spun out from RNP into its own project.

Mach vendor does not handle subrepos. The RNP developers are providing complete source tar files as Github release artifacts that include the submodule.

Comment 1

[Rob Lemley [:rjl]]

The plan is to add an optional "release-artifact" field to the "vendoring" section of the manifest. If the field is present, it's used to build a download URL instead of the git-archive export URL currently used.

Initial implementation will support Github only.

Comment 2

[Rob Lemley [:rjl]]

Attachment: WIP: Bug 1831682 - [mach vendor] Use Github API to find new tags.

The Github repos API can also look up tags by tag name and provide
the timestamp as required.
In the case where the latest tag is unknown, there is a "tags" endpoint
that lists all known tags, latest first. Once the tag name is known, the
timestamp can be looked up as above.
This change means Github API calls are used when checking for updates and
it's no lohger necessary to clone the entire repository to look for a new
version.

Comment 3

[Rob Lemley [:rjl]]

Attachment: Bug 1831682 - [mach vendor] Use Github release artifacts as alternative to git-archive tar files. r=tjr

If a Github project provides source tar files as release artifacts, allow
using them as an alternative to git-archive exports. This is useful when
a Git repository uses submodules, which are not part of the auto-generated
archive exports.

Depends on D177333

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d73c26430921
[mach vendor] Use Github release artifacts as alternative to git-archive tar files. r=tjr

Comment 5

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/d73c26430921