1587566 - Establush per-product success metric monitoring and alerting if metrics start tracking away from forecasted model.

Status: RESOLVED INACTIVE

(Data Science :: Meta, enhancement)

Description

[Keith Willowhawk]

Brief Description of the request (required):

Each product has top-level MAU that we track for aggregate and long term success tracking in terms of "are people using our products", but we lack instrumentation and alerting if something happens either with a product release, market condition change, user sentiment swing, etc. that might start moving the xAU measures off the forecasted track.

Business purpose for this request (required):

This will allow product, marketing and other interested stakeholders to get more pro-active warning that "something is wrong", and give an opportunity to begin the investigation into causes (be they infrastructure, product reaction or market change, etc.) and begin considering reactionary countermeasures to mitigate impact early.

Requested timelines for the request or how this fits into roadmaps or critical decisions (required):

This is immediately relevant, and in part will build off of the earlier request for product success measures in Fenix (link TBD)

Links to any assets (e.g Start of a PHD, BRD; any document that helps describe the project):

Name of Data Scientist (If Applicable):

Please note if it is found that not enough information has been given this will delay the triage of this request.

Comment 1

[Jess Mokrzecki [:jmok]]

Work for the DS team is now tracked in Jira. You can search with the Data Science Jira project for the corresponding ticket.