1179035 - Compress existing deployed json

Status: RESOLVED FIXED

(Content Services Graveyard :: Tiles, defect)

Description

[Ed Lee :Mardak]

With bug 1179029, we could reduce some working directory space usage (although the big files will still be in commit history)..

Comment 1

[Ed Lee :Mardak]

oldest
-rw-r--r--    1 Ed  501   204250 Oct 15  2014 2014-09-02.first-release.json
-rw-r--r--    1 Ed  501   145460 Jun 30 16:34 2014-09-02.first-release.json.bz2

newest
-rw-r--r--    1 Ed  501 92208621 Jun 30 16:11 desktop-prerelease.2015-06-30.nogroundbreaking.json
-rw-r--r--    1 Ed  501  1779994 Jun 30 16:36 desktop-prerelease.2015-06-30.nogroundbreaking.json.bz2

commands:
> $ find . -name "*.bz2" -exec bunzip2 {} \;
> $ find . -name "*.json" | while read json; do cat $json | ../upcoming/tile-converter.py > out.json; mv out.json $json; bzip2 $json; done

du -ks .
before: 6192564
after:   276480

Comment 2

[[github robot]]

Commit pushed to master at https://github.com/mozilla/tiles-data

https://github.com/mozilla/tiles-data/commit/3a8ffc5b0f67ba9e83d79cf7dcd100702a41c77b
Closes Bug 1179035 - Compress existing deployed json