Closed Bug 1043656 Opened 10 years ago Closed 9 years ago

Queue: Add expiration to task definition

Categories

(Taskcluster :: Services, defect)

Product:
Taskcluster
Component:
Services
Platform:
x86_64
Linux
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: jonasfj, Assigned: jonasfj)

References

Details

Currently tasks and task structure structures are not being deleted from azure blob storage.

We should obviously delete them at some point. I suggest that we add an `expires` attribute to the task definition and:
 1. require that expires > deadline
 2. delete task definition and status after when now() > expires
 3. forbid artifacts with expiration later than expires
    (perhaps defaults artifact expiration to expires)

This is the last piece to make the queue clean up after itself.

Note, it might be worth considering to store the task status structure in azure table storage instead. Because the scan would be much simpler. Though we would need one row for each run. It would also make many point queries a lot faster.
Severity: enhancement → normal
Assignee: nobody → jopsen
This will be implemented with bug 1121293 and deployed in the same go.
Depends on: 1121293
This was rolled out 4 weeks ago...
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Component: TaskCluster → Queue
Product: Testing → Taskcluster
Component: Queue → Services
You need to log in before you can comment on or make changes to this bug.