Closed Bug 1478803 Opened 7 years ago Closed 7 years ago

Move artifacts older than 45 days to Infrequent Access

Categories

(Taskcluster :: Operations and Service Requests, task)

Product:
Taskcluster
Component:
Operations and Service Requests
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: coop, Assigned: coop)

Details

Back in June, I setup storage class analysis for our taskcluster-public-artifacts bucket (the big one) in S3. That's been running for a month now, and we have some data to look at: https://s3.console.aws.amazon.com/s3/buckets/taskcluster-public-artifacts/?region=us-west-2&tab=management The automated analysis suggests that we should move all artifacts older than 45 days to Infrequent Access. Basic storage class info can be found here: https://aws.amazon.com/s3/storage-classes/ There another access cliff at 120 days, so we might also consider moving artifacts older than 120 days to Glacier.
I've created a lifecycle rule to move artifacts to Infrequent Access after 45 days: https://screenshots.firefox.com/npAecPzEtug7LBTZ/s3.console.aws.amazon.com Planning to leave this open to monitor the outcome.
Assignee: nobody → coop
Status: NEW → ASSIGNED
One interesting thing to watch is if there are a few highly-used artifacts (docker images? toolchains?) that get moved to IA.
Marking as done. This ended up saving us about 30% on our S3 costs in October.
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Component: Operations → Operations and Service Requests
You need to log in before you can comment on or make changes to this bug.