1590054 - enable a dashboard to glance at end-to-end times for graphs

Status: RESOLVED WONTFIX

(Release Engineering :: General, task)

Description

[Mihai Tabara [:mtabara]⌚️GMT]

With the recent end-to-end work in bug 1552485, some folks in RelEng suggested that that kind of data would be handy to have on a daily/weekly/monthly basis so that we can corelate easier the events that happen in infrastructure with what's changed in our workflow, development or operational, alike.

Some of the initial thoughts were towards baking the scripts we've used in bug 1552485 to measure end-to-end graph times, somehow in the promotion graph and compare that against the historical benchmark. However, Simon and Callek have already been doing lots of great work in measuring-ci world and most of this data already exists. So it'd be easier to simply piggyback on that.

I met with Simon today and it seems like in Q4 we're aiming towards providing these dashboards in GCP, per task group. Adding another column there to measure end to end time should be straightforward after that.

Once we have that, it could be releaseduty's responsabilities to query for costs / end to end times for our release graphs to early find potential culprits.

This bug is tracking that work.

Comment 1

[Chris AtLee [:catlee]]

My $0.02 - let's try and generate these dashboards from the data in BigQuery if we can.