1882407 - Stop compressing target.maven.tar.xz

Status: RESOLVED FIXED

(Release Engineering :: General, enhancement)

Description

[Geoff Brown [:gbrown]]

Geckoview builds, including the build-fat-aar builds, currently create a "maven archive" artifact as an xz-compressed tar file. For the build-fat-aar task, archive creation typically takes almost 2 minutes. An uncompressed archive can be built in just 1 second, and is less than 1% larger.

Comment 1

[Geoff Brown [:gbrown]]

Since the applicable log times appear to be buffered, it's tricky to measure the duration of archive creation. I added some custom logging:
https://treeherder.mozilla.org/jobs?repo=try&revision=1ed78ced9125b5a7a12998d28ebfad9dc4622b0d
Bgv target.maven.tar.xz size: 261336200
Archive creation duration: 106 seconds

I tried setting the compresslevel=1:
https://treeherder.mozilla.org/jobs?repo=try&revision=f4fb430d91919a4b8ab39663d2b6eb7475fff447
Bgv target.maven.tar.xz size: 261489644
Archive creation duration: 54 seconds

And I tried removing compression entirely:
https://treeherder.mozilla.org/jobs?repo=try&revision=09061fce70a2acce290ef28d867283c209db1e2d
Bgv target.maven.tar.xz size: 262768640
Archive creation duration: 0.2 seconds

Comment 2

[Geoff Brown [:gbrown]]

More realistic patch: https://treeherder.mozilla.org/jobs?repo=try&revision=bcb2898cf89b5ecdbb2082055cfff5778462a3ed

Comment 3

[Julien Cristau [:jcristau]]

Probably worth noting that "removing compression entirely" doesn't actually remove all compression, it means the file is gzipped by docker-worker after the build completes. (Which might still be faster, but the compression time gets hidden away.)

Comment 4

[Geoff Brown [:gbrown]]

Attachment: Bug 1882407 - Stop compressing target.maven.tar.xz

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0f18d165d124
Stop compressing target.maven.tar.xz r=geckoview-reviewers,owlish,tthibaud

Comment 6

[pstanciu]

https://hg.mozilla.org/mozilla-central/rev/0f18d165d124