1754501 - Clean up obsolete artifacts in ".mozbuild"

Status: RESOLVED FIXED

(Testing :: Mozbase, enhancement)

Description

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

I nearly filled up my hard drive and I'm removing unnecessary files. I've found a few compressed files in my .mozbuild directory that seem like they can be removed (since they seem to have directories associated with them) and take up non-trivial space:

• 574 MB rust-dist-toolchain.tar.xz
• 147 MB android-device/host-utils-93.0a1.en-US.mac.tar.gz
• 146 MB android-device/host-utils-85.0a1.en-US.mac.tar.gz
• 56 MB clang-dist-toolchain.tar.xz

If it's not too much work, I wonder if we should do one or more of:

• can we update the tasks that generate these files to remove them after use?
• should we automatically scan .mozbuild for compressed artifacts and print a warning if they are not removed so someone can file a bug?
• should we automatically delete compressed artifacts? (probably not because they might be used)

Impact

It is less than a 1 GiB so maybe it's not worth the time but it is distributed across many developers computers who may need to take the time to reclaim that space later and that may be a lot of time.

Comment 1

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

wrt impact, my npm cache (6G), gradle cache (19G+), cargo (7G), etc. greatly exceed the space taken up by these files so maybe it's not a big deal.

Comment 2

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Yeah, I'm just going to close this.

Comment 3

[Mitchell Hentges [:mhentges] 🦀]

This is a valid bug, but I don't think that the priority is that great.
I'll reopen and chuck it in the backlog. Thanks for the report :)

Comment 4

[Mike Hommey [:glandium]]

I'm fairly sure the dist-toolchains ones are supposed to be there compressed, and are used as-is by sccache in distributed mode.
The host-utils part comes from mozrunner.

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

The product::component has been changed since the backlog priority was decided, so we're resetting it.
For more information, please visit auto_nag documentation.

Comment 6

[Geoff Brown [:gbrown]]

Attachment: Bug 1754501 - Remove host-utils archive after unpacking; r=

Save some disk space by removing host-utils archive after it has been unpacked.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5f702d38e626
Remove host-utils archive after unpacking; r=aerickson

Comment 8

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/5f702d38e626