Perform adhoc queries on TH data

NEW
Assigned to

Status

Testing
ActiveData
10 months ago
3 months ago

People

(Reporter: ekyle, Assigned: ekyle)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

10 months ago
Performing adhoc queries on TH data allows me to identify specific instances of data corruption, and have a way to monitor the size of the problem, track its resolution using a query.

For example, Treeherder leaves jobs in a running state [1].  ActiveData can now be used to track this problem, count the size, or calculate the percent, and the query can be used to confirm the problem is resolved.

We can not do this for Treeherder unless we ingest Treeherder data.

[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1296077
No longer depends on: 1296634
(Assignee)

Updated

5 months ago
Depends on: 1296634
(Assignee)

Comment 1

3 months ago
The current index holds Treeherder job snapshots, not just completed jobs.  This was done as an easy way to ensure we have the latest job information.

The next step is to add expiry dates to all the snapshots that have been superseded so we can filter them out.
You need to log in before you can comment on or make changes to this bug.