1423882 - Use a sparse profile for upload-generated-sources tasks

Status: RESOLVED FIXED

(Firefox Build System :: General, enhancement)

Description

[(not currently active) Ted Mielczarek]

I added upload-generated-sources tasks in bug 1259832, and they use `run-task` to run an in-tree script with `mach python`, which is handy for not having to jump through hoops to make things work. We can make this better by using a sparse profile to checkout fewer files.

I pushed this patch to try and the resulting Ugs job for linux64-opt took 4 minutes:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=236aaff03265c2e430023c695545efe8ecb71cd9&selectedJob=150488302

That's a full minute faster than the latest linux64-opt Ugs run I found on central:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=nightly&selectedJob=150455104

Comment 1

[(not currently active) Ted Mielczarek]

To be more precise, the Ugs task on my try push took 214.3 seconds, and the Ugs task on that nightly build on central took 292.4 seconds, so it's a bit more than a minute (but probably subject to some variability).

Comment 2

[(not currently active) Ted Mielczarek]

Attachment: bug 1423882 - Define and use a sparse profile for upload-generated-sources tasks.

upload-generated-sources tasks simply use `mach python` to run an in-tree
script, so they can save time by using a sparse profile.

Review commit: https://reviewboard.mozilla.org/r/206250/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/206250/

Comment 3

[(not currently active) Ted Mielczarek]

This patch adds an `upload-generated-sources` sparse profile which is just the `mach` profile but with a single Python script added. Alternately, I could just add that single Python script to the `mach` profile to avoid adding a new sparse profile. I think either way is probably OK.

Comment 4

[Gregory Szorc [:gps]]

Comment on attachment 8935355 [details]
bug 1423882 - Define and use a sparse profile for upload-generated-sources tasks.

https://reviewboard.mozilla.org/r/206250/#review212600

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7b77cca253e5
Define and use a sparse profile for upload-generated-sources tasks. r=gps

Comment 6

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/7b77cca253e5