1571636 - Expose build resources data from automation build as artifacts

Status: RESOLVED FIXED

(Firefox Build System :: General, task)

Comment 1

[Mike Hommey [:glandium]]

Attachment: Bug 1571636 - Get d3.js from https.

Comment 2

[Mike Hommey [:glandium]]

Attachment: Bug 1571636 - Make the build resources list file contain the full relative path to all resource files.

Rather than imply they should all be in the resources subdirectory.

Comment 3

[Mike Hommey [:glandium]]

Attachment: Bug 1571636 - Rename the build resources list file and allow it not to be a list.

The longer version is that this changes how the HTML viewer looks up
files. Instead of looking at a list file that contains a list of
build resources data, it now looks at a build_resources.json file that
either contains data directly, or a list of files containing data.

Comment 4

[Mike Hommey [:glandium]]

Attachment: Bug 1571636 - Expose build resources data from automation builds as artifacts.

The build docker images need python-dev installed to build psutil, used
by the build resources monitor.

Comment 5

[Mike Hommey [:glandium]]

Attachment: Bug 1571636 - Use a fetch task artifact to get upx source.

Comment 6

[Mike Hommey [:glandium]]

FWIW, this shows interesting stuff:
https://taskcluster-artifacts.net/RzlkFcHFQoeAUl--VOQ28Q/0/public/build/build_resources.html
That's a linux PGO build (not instr). The first part of the compile tier indicates https://github.com/rust-lang/cargo/issues/6747 might not be entirely fixed or some other related issue still exists. Then the two parts where we suck only 50% CPU is a combination of libxul-gtest waiting for libxul to finish and bug 1483846. I suspect the gap between both and the long tail after the second is the linker finishing to deal with debug info for each library. This makes me wonder if we should move the libxul-gtest build to a completely separate build. Or allow both libraries to build in parallel, but that'd suck much more memory and won't be twice as fast.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1cab7c3bd2b0
Get d3.js from https. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/d8b7cd29ebe1
Make the build resources list file contain the full relative path to all resource files. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/75201c842d49
Rename the build resources list file and allow it not to be a list. r=nalexander
https://hg.mozilla.org/integration/autoland/rev/3fe035323cee
Expose build resources data from automation builds as artifacts. r=nalexander

Comment 8

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/1cab7c3bd2b0
https://hg.mozilla.org/mozilla-central/rev/d8b7cd29ebe1
https://hg.mozilla.org/mozilla-central/rev/75201c842d49
https://hg.mozilla.org/mozilla-central/rev/3fe035323cee