Enable request metrics for artifact and blob buckets
Categories
(Cloud Services :: Operations: Taskcluster, task)
Tracking
(Not tracked)
People
(Reporter: brian, Unassigned)
Details
We should enable request metrics for all the artifact and blob buckets. Files in them are accessed directly by workers, so we need to understand the request and error count as well as the request timing.
https://docs.aws.amazon.com/AmazonS3/latest/user-guide/configure-metrics.html covers doing it manually
https://www.terraform.io/docs/providers/aws/r/s3_bucket_metric.html may be the terraform equivalent.
I have manually enabled metrics on:
- communitytc-private-artifacts
- communitytc-private-blobs
- communitytc-public-artifacts
- communitytc-public-blobs
- firefoxcitc-private-artifacts
- firefoxcitc-private-blobs
- firefoxcitc-public-artifacts
- firefoxcitc-public-blobs
We might want to revisit this later on to verify that the metrics from the "private" buckets are actually useful -- they are marked "objects can be public" so it's very possible the workers are doing public stuff in them. Next week I'll run the "past 7 days' spend" numbers again on Thursday, and if the metrics stick out as having inflated the AWS bill, I'll raise the issue of seeing if we can figure out how to get by with less of them.
Reporter | ||
Comment 2•5 years ago
|
||
Can this be added to terraform so all deployments get it automatically?
Description
•