1805699 - CI builds are not using sccache since GCP migration in bug 1792251

Status: RESOLVED FIXED

(Thunderbird :: Build Config, defect)

Description

[Rob Lemley [:rjl]]

Attachment: image.png

Since CI builds moved to GCP, they are not using sccache apparently as its hit rate is 0%.

The graphic from perfherder shows that after October 6, sccache has not been utilized. This aligns with https://treeherder.mozilla.org/jobs?repo=comm-central&revision=245a02b78fb7ce2407b9fd0109bb32a3c348a46f which includes the build jobs moving to GCP.

Comment 1

[Rob Lemley [:rjl]]

sccache.log contains numerous entries like:

[opt_constant_folding.o]: generate_hash_key took 0.097 s
Error getting credentials: didn't get a successful HTTP status, got `403 Forbidden`
Got GCS error: didn't get a successful HTTP status, got `403 Forbidden`
[opt_constant_folding.o]: Cache miss in 0.000 s
[opt_constant_folding.o]: Compiling locally
[opt_constant_folding.o]: Compiled in 0.258 s, storing in cache
handle_client: compile
check_compiler: Supported compiler
parse_arguments: Ok: [..... "glsl-optimizer/src/compiler/glsl/opt_constant_propagation.cpp"]
[opt_constant_propagation.o]: get_cached_or_compile: [..... "glsl-optimizer/src/compiler/glsl/opt_constant_propagation.cpp"]
[opt_constant_folding.o]: Cache write error: failed to put cache entry in GCS
    
    Caused by:
        didn't get a successful HTTP status, got `403 Forbidden`
[opt_constant_folding.o]: Cache write finished in 0.258 s

So sccache is unable to retrieve its credehtials (first 403) which generates a cache miss. Then it fails writing back to the cache resulting in the second 403.

Comment 2

[Rob Lemley [:rjl]]

Attachment: Bug 1805699 - Use a prefix on GCP sccache bucket names. r=#firefox-build-system-reviewers

Allows use of different buckets for different build products such as
Thunderbird which does not have access to the Firefox sccache buckets and
should be kept separated.

Comment 3

[Rob Lemley [:rjl]]

Attachment: Bug 1805699 - Set GCP sccache bucket prefix for Thunderbird builds. r=dandarnell

Set a sccache bucket name prefix for GCP similar to the AWS one.

Comment 4

[Rob Lemley [:rjl]]

comm-central piece should be safe to land early.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/455aa95a34de
Use a prefix on GCP sccache bucket names. r=firefox-build-system-reviewers,ahochheiden

Comment 6

[Marian-Vasile Laza]

https://hg.mozilla.org/mozilla-central/rev/455aa95a34de

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/comm-central/rev/451f2cab264f
Set GCP sccache bucket prefix for Thunderbird builds. r=dandarnell