1863497 - Upgrade sccache to 0.7.1, direct/preprocessor mode by default and enable adv stats

Status: RESOLVED FIXED

(Firefox Build System :: Toolchains, task)

Comment 1

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 1863497 - Build sccache with a more recent version of rust r?glandium

Comment 2

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 1863497 - Upgrade sccache to 0.7.4 r?glandium

Depends on D192930

Comment 3

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 1863497 - sccache: enable --show-adv-stats when storing stats r?glandium

Depends on D192931

Comment 4

[Sylvestre Ledru [:Sylvestre]]

with

cargo install sccache

Some benchmark results with sccache direct/processor mode (took 19m to run this benchmark) :

hyperfine --warmup 1 "bash bench-without.sh" "bash bench-with.sh"
Benchmark 1: bash bench-without.sh
  Time (mean ± σ):     69.406 s ±  4.229 s    [User: 275.969 s, System: 53.104 s]
  Range (min … max):   63.897 s … 75.104 s    10 runs

Benchmark 2: bash bench-with.sh
  Time (mean ± σ):     30.454 s ±  1.541 s    [User: 271.775 s, System: 51.225 s]
  Range (min … max):   29.026 s … 33.550 s    10 runs

Summary
  bash bench-with.sh ran
    2.28 ± 0.18 times faster than bash bench-without.sh

My ugly scripts

bench-without.sh:

cd ~/.mozbuild/sccache/
rm -f *
ln -s ~/.cargo/bin/sccache
cd -

killall sccache

~/.cargo/bin/sccache --start-server

fd '\.o$' obj-* | xargs rm && time ./mach build
~/.cargo/bin/sccache --show-adv-stats

bench-with.sh

cd ~/.mozbuild/sccache/
rm -f *
ln -s ~/.cargo/bin/sccache
cd -

killall sccache

SCCACHE_DIRECT=true ~/.cargo/bin/sccache --start-server

fd '\.o$' obj-* | xargs rm && time ./mach build
~/.cargo/bin/sccache --show-adv-stats

Comment 5

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 1863497 - sccache: update the doc r?glandium

Depends on D192932

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1caa79ee637e
Upgrade sccache to 0.7.2 r=glandium
https://hg.mozilla.org/integration/autoland/rev/c959dafcf46f
sccache: enable --show-adv-stats when storing stats r=glandium
https://hg.mozilla.org/integration/autoland/rev/ce9934edcec1
sccache: update the doc r=glandium

Comment 7

[Atila Butkovits]

Backed out for causing bustages.

Backout link: https://hg.mozilla.org/integration/autoland/rev/c83ba137e470a8008728c61a40a4ff036f28bf59

Push with failures: https://treeherder.mozilla.org/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&searchStr=windows%2C2012%2Cx64%2Cdebug%2Cbuild-win64-non-unified%2Fplain%2Cbp-nu&revision=ce9934edcec1f7fb5a45a88621d00dbb79df03cc&selectedTaskRun=RvbuslmARUiU9oQyHlyetQ.0

Failure log: https://treeherder.mozilla.org/logviewer?job_id=436479919&repo=autoland&lineNumber=155767

Comment 8

[Sylvestre Ledru [:Sylvestre]]

I opened:
https://github.com/mozilla/sccache/issues/1967
for this

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6e2d251d7e5e
Upgrade sccache to 0.7.4 r=glandium
https://hg.mozilla.org/integration/autoland/rev/ab7d4ec6fce6
sccache: enable --show-adv-stats when storing stats r=glandium
https://hg.mozilla.org/integration/autoland/rev/7d38b1ea5653
sccache: update the doc r=glandium

Comment 10

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/6e2d251d7e5e
https://hg.mozilla.org/mozilla-central/rev/ab7d4ec6fce6
https://hg.mozilla.org/mozilla-central/rev/7d38b1ea5653