Queue: Add expiration to task definition

RESOLVED FIXED

Status

Taskcluster
Queue
RESOLVED FIXED
3 years ago
2 years ago

People

(Reporter: jonasfj, Assigned: jonasfj)

Tracking

Details

(Assignee)

Description

3 years ago
Currently tasks and task structure structures are not being deleted from azure blob storage.

We should obviously delete them at some point. I suggest that we add an `expires` attribute to the task definition and:
 1. require that expires > deadline
 2. delete task definition and status after when now() > expires
 3. forbid artifacts with expiration later than expires
    (perhaps defaults artifact expiration to expires)

This is the last piece to make the queue clean up after itself.

Note, it might be worth considering to store the task status structure in azure table storage instead. Because the scan would be much simpler. Though we would need one row for each run. It would also make many point queries a lot faster.
(Assignee)

Updated

3 years ago
Severity: enhancement → normal
(Assignee)

Updated

3 years ago
Assignee: nobody → jopsen
(Assignee)

Comment 1

3 years ago
This will be implemented with bug 1121293 and deployed in the same go.
Depends on: 1121293
(Assignee)

Comment 2

3 years ago
This was rolled out 4 weeks ago...
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
Component: TaskCluster → Queue
Product: Testing → Taskcluster
You need to log in before you can comment on or make changes to this bug.