Was curious about xz, so switched my script to use xz/lzma compression: ``` en-US linux-x86_64: 83.18mb -> 65.46mb (21.30% smaller) fr linux-i686 : 84.68mb -> 68.52mb (19.09% smaller) fr linux-x86_64: 83.67mb -> 65.79mb (21.37% smaller) pt-BR linux-i686 : 84.53mb -> 68.32mb (19.17% smaller) ach linux-x86_64: 83.38mb -> 65.36mb (21.60% smaller) en-US linux-i686 : 84.50mb -> 68.18mb (19.31% smaller) ach linux-i686 : 84.37mb -> 68.09mb (19.30% smaller) en-CA linux-i686 : 84.63mb -> 68.21mb (19.41% smaller) fi linux-i686 : 84.38mb -> 68.15mb (19.23% smaller) fi linux-x86_64: 83.19mb -> 65.43mb (21.35% smaller) pt-BR linux-x86_64: 83.59mb -> 65.59mb (21.53% smaller) en-CA linux-x86_64: 83.27mb -> 65.49mb (21.35% smaller) es-ES linux-x86_64: 83.68mb -> 65.63mb (21.58% smaller) bs linux-x86_64: 83.16mb -> 65.40mb (21.36% smaller) he linux-x86_64: 83.27mb -> 65.43mb (21.43% smaller) es-ES linux-i686 : 84.63mb -> 68.36mb (19.22% smaller) bs linux-i686 : 84.34mb -> 68.11mb (19.24% smaller) he linux-i686 : 84.32mb -> 68.16mb (19.16% smaller) Average reduction: 20.33% ``` Also ran some tests to find memory usage + time spent. (keep in mind this is running on my local computer, YMMV) Using build: en-US linux-x86_64 firefox 130.0 (84MB in tar.bz2 format) _____ ### Compressing zstd with `-22`: *~1GB* of memory in *171 seconds* -> *71MB* xz with `-9`: *~730MB* of memory in *143 seconds* -> *65MB* bzip2 with `-9`: *~20MB* of memory in *20 seconds* -> *84MB* (ran via cli and not python) _____ ### Decompressing (all via cli) zstd: *140MB* of memory in *5 seconds* xz: *73MB* of memory in *6 seconds* bzip2: *12MB* of memory in *10 seconds* ____ By looking at these numbers, it seems xz is a more sensible option than zstd? It does use more memory than bzip2 to decompress, but I don't think <100MB of ram usage is a huge concern?
Bug 1710599 Comment 15 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
Was curious about xz, so switched my script to use xz/lzma compression: ``` en-US linux-x86_64: 83.18mb -> 65.46mb (21.30% smaller) fr linux-i686 : 84.68mb -> 68.52mb (19.09% smaller) fr linux-x86_64: 83.67mb -> 65.79mb (21.37% smaller) pt-BR linux-i686 : 84.53mb -> 68.32mb (19.17% smaller) ach linux-x86_64: 83.38mb -> 65.36mb (21.60% smaller) en-US linux-i686 : 84.50mb -> 68.18mb (19.31% smaller) ach linux-i686 : 84.37mb -> 68.09mb (19.30% smaller) en-CA linux-i686 : 84.63mb -> 68.21mb (19.41% smaller) fi linux-i686 : 84.38mb -> 68.15mb (19.23% smaller) fi linux-x86_64: 83.19mb -> 65.43mb (21.35% smaller) pt-BR linux-x86_64: 83.59mb -> 65.59mb (21.53% smaller) en-CA linux-x86_64: 83.27mb -> 65.49mb (21.35% smaller) es-ES linux-x86_64: 83.68mb -> 65.63mb (21.58% smaller) bs linux-x86_64: 83.16mb -> 65.40mb (21.36% smaller) he linux-x86_64: 83.27mb -> 65.43mb (21.43% smaller) es-ES linux-i686 : 84.63mb -> 68.36mb (19.22% smaller) bs linux-i686 : 84.34mb -> 68.11mb (19.24% smaller) he linux-i686 : 84.32mb -> 68.16mb (19.16% smaller) Average reduction: 20.33% ``` Also ran some tests to find memory usage + time spent. (keep in mind this is running on my local computer, YMMV) Using build: en-US linux-x86_64 firefox 130.0 (84MB in tar.bz2 format) _____ ### Compressing zstd with `-22`: *~1GB* of memory in *171 seconds* -> file size: *71MB* xz with `-9`: *~730MB* of memory in *143 seconds* -> file size: *65MB* bzip2 with `-9`: *~20MB* of memory in *20 seconds* -> file size: *84MB* (ran via cli and not python) _____ ### Decompressing (all via cli) zstd: *140MB* of memory in *5 seconds* xz: *73MB* of memory in *6 seconds* bzip2: *12MB* of memory in *10 seconds* ____ By looking at these numbers, it seems xz is a more sensible option than zstd? It does use more memory than bzip2 to decompress, but I don't think <100MB of ram usage is a huge concern?