Docker Worker "status" page

RESOLVED WONTFIX

Status

RESOLVED WONTFIX
4 years ago
10 months ago

People

(Reporter: jlal, Unassigned, Mentored)

Tracking

Details

(Whiteboard: [docker-worker])

(Reporter)

Description

4 years ago
Each worker has a number of useful stats which are not obvious or visible outside of the logs... We should add a read only public endpoint which shows worker stats...

The fun stuff:

Adding:

  - uptime stats
  - current time to shutdown
  - current tasks running (task id's with links to the inspector)
  - etc...

Details:

We should not utilize too many resources and/or put this behind a feature flag so lower end nodes don't need to waste resources on serving this... Primary concern is memory (node can eat it very quickly for high levels of concurrency which generally the tasks need) and security (ideally this runs in a different process as the actual worker code)
(Reporter)

Updated

4 years ago
Mentor: jlal
It might be nice to make this an artifact too.
Normally, we only want to investigate this when a task behaved weird.

Ie. an artifact public/stats/docker-worker.htm might be nice. So we see statistics like this even after a run as was resolved. It's easily more useful and easier to implement this as an artifact created by docker-worker.
And could in that case be hidden in a task.payload feature flag.
(Reporter)

Comment 2

4 years ago
I see that being useful too but my intention is for debugging stuff as the worker runs (edge case) or in the case that the worker is not shutting down or whatever which does not work as an artifact.
Ahh... I see, that makes sense.
(Reporter)

Comment 4

4 years ago
ah and disk space and some other stats which don't fuck up the worker as it is running...
(Reporter)

Comment 5

4 years ago
Going to take an initial stab at this .. My plan is to expose a "json" endpoint (which will run in a different process) which we can then build a "UI" for... How we expose the link for this is unclear but for people working on TC this will be useful right away to inspect the running state of the worker.
Assignee: nobody → jlal
(Reporter)

Updated

4 years ago
Assignee: jlal → nobody
Component: TaskCluster → General
Product: Testing → Taskcluster

Updated

3 years ago
Component: General → Docker-Worker
Whiteboard: [docker-worker]
Component: Docker-Worker → Worker

Updated

10 months ago
Status: NEW → RESOLVED
Last Resolved: 10 months ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.