1341743 - record upload metrics for docker-worker

Status: RESOLVED FIXED

(Taskcluster :: Workers, defect)

Description

[John Ford [:jhford] CET/CEST Berlin Time]

I would like to be able to compare the performance of the new artifact api against the older one.  Please let me know if we already have metrics for this, I'm happy to look at them!

I would like to have metrics for:

1. time of each individual upload in seconds, per region and globally
2. number of bytes of each individual upload, per region and globally
3. average speed of each individual upload in bytes/second, per region and globally

I think this metric will serve later as a good metric to optimize our artifact subsystem further, but I'm also happy to disable once my work is done.

Thanks!

Comment 1

[John Ford [:jhford] CET/CEST Berlin Time]

if this is too many metrics to record, I'd like to have only the third (speed).

Comment 2

[John Ford [:jhford] CET/CEST Berlin Time]

minor change to the request, let's make the total time in milliseconds but keep the speed in bytes/second

Comment 3

[[github robot]]

Commits pushed to master at https://github.com/taskcluster/docker-worker

https://github.com/taskcluster/docker-worker/commit/bd6cf2b966b3a78e45b90bd8c86c94a18692d7a5
Bug 1341743: record artifact upload metrics. r=garndt,jhford

Record time, number of bytes and transfer rate for each artifact
uploaded.

https://github.com/taskcluster/docker-worker/commit/68bfde7053ae85f58e99668ce47d6ad47acee5cb
Merge pull request #286 from walac/master

Bug 1341743: record artifact upload metrics. r=garndt,jhford

Comment 4

[Wander Lairson Costa]

https://github.com/taskcluster/docker-worker/commit/68bfde7053ae85f58e99668ce47d6ad47acee5cb