Closed Bug 1665857 Opened 4 years ago Closed 3 years ago

[meta] Address data retention in Perfherder

Categories

(Tree Management :: Perfherder, task, P3)

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: igoldan, Unassigned)

References

(Blocks 1 open bug)

Details

(Keywords: meta)

In bug 1346567, we managed to re enable the expiring algorithm for perf data.

It's main mechanics are working up to this day. We're now keeping the performance_datum table at ~300 million rows (while previously it peaked at >750 million).

However, there are other tweaks we could employ to further expire useless perf data. So we have more decent sized tables (performance_datum, performance_signature, performance_alert_summary).

See Also: → 1654496
Blocks: 1665859
Depends on: 1667051
Depends on: 1668511
Depends on: 1668543
Depends on: 1669490
Depends on: 1670866
Depends on: 1671564
Depends on: 1673828
Depends on: 1673911
Depends on: 1682580
Depends on: 1682764
Depends on: 1682849
Depends on: 1683042
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED

Outcome of this meta:

  • reduced perf datum table from ~300 million to ~140 million rows
  • we're now expiring empty alert summaries as well
  • we're now expiring perf signatures which no longer have any points

That's great - thanks!

You need to log in before you can comment on or make changes to this bug.