Last Comment Bug 1280641 - Implement a two-tier S3 cache for sccache
: Implement a two-tier S3 cache for sccache
Status: NEW
Product: Core
Classification: Components
Component: Build Config (show other bugs)
: unspecified
: Unspecified Unspecified
P1 normal with 1 vote (vote)
: ---
Assigned To: Ted Mielczarek [:ted.mielczarek]
: Gregory Szorc [:gps] (away until 2017-03-20)
Depends on: 1280640
Blocks: thunder-try
  Show dependency treegraph
Reported: 2016-06-17 07:33 PDT by Ted Mielczarek [:ted.mielczarek]
Modified: 2016-07-13 12:45 PDT (History)
1 user (show)
See Also:
Crash Signature:
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---


Description User image Ted Mielczarek [:ted.mielczarek] 2016-06-17 07:33:56 PDT
Currently sccache on try uses a different S3 bucket from inbound etc, because we don't want try builds to be able to poison the inbound cache with junk. Unfortunately this means that try builds don't benefit from cached objects that have already been built on other branches.

Once we fix bug 1280640 such that cross-branch cache hits are possible, we can add support to sccache for a two-tier S3 cache and configure try builds to use the inbound bucket as a read-only cache, and then still write to a separate bucket. This should make some try builds faster because they'll be able to pull objects from cache where they would have had to build.
Comment 1 User image Armen Zambrano - Back on March 27th [:armenzg] (EDT/UTC-4) 2016-07-08 12:24:35 PDT
ted might be able to tackle this by the end of this month.
More info in dependent bug.
Comment 2 User image Armen Zambrano - Back on March 27th [:armenzg] (EDT/UTC-4) 2016-07-08 12:26:27 PDT
I also want to point out that it is unclear how much gain we will get from this work.
However, since it is not a lot of work to get it done as we will most likely get *some* gains even if not large.
Comment 3 User image Armen Zambrano - Back on March 27th [:armenzg] (EDT/UTC-4) 2016-07-13 12:45:34 PDT
P1 == we're commiting to complete this within this quarter.

Note You need to log in before you can comment on or make changes to this bug.