1684961 - Create dashboard to track changes in range of days update is available -> days update is applied.

Status: RESOLVED FIXED

(Toolkit :: Application Update, task, P1)

Description

[Rachel Tublitz [:rachel]]

One way to measure the effectiveness of the background update agent is to look at the average length of time between "update available" and "update applied" for clients. Presumably, that timeframe should get significantly shorter.

This bug will track creation of a dashboard to measure this.

Comment 1

[Rachel Tublitz [:rachel]]

Here's where this info will live, consolidated into what will eventually be the background update agent monitoring dashboard:
https://sql.telemetry.mozilla.org/dashboard/background-update-agent

I've started with tracking against the release channel.

Next steps before closing this out is:

1. circulate for review as-is for release channel.
2. add relevant details for beta channel (skipping nightly as "days between releases" don't really apply there...however would be good to have relevant monitoring for beta ahead of enabling against release)

Comment 2

[Rachel Tublitz [:rachel]]

Added details for beta as well as links to a few other dashboards. Final dashboard lives here:
https://sql.telemetry.mozilla.org/dashboard/background-update-agent

Will circulate for review this week and close this out next week as complete assuming no major changes required.

Comment 3

[Rachel Tublitz [:rachel]]

ni-ing myself so I don't lose track of improvements/changes to make:

• Include details on number of update prompts shown.

Comment 4

[Rachel Tublitz [:rachel]]

Found the right histograms to track (UPDATE_NOTIFICATION_BADGE_SHOWN and UPDATE_NOTIFICATION_SHOWN) and added links to the top of the main BUA tracking dashboard.