1920121 - Request to publish CAT2 performance data on external dashboard

Status: RESOLVED FIXED

(Data Platform and Tools :: General, task)

Description

[Denis Palmeiro [:denispal]]

The performance team would like to publish some statistics about various performance metrics on an external public facing dashboard. The statistics would include the mean, median, 95th, and 99th percentile over a 1-2 year span for metrics that are CAT2 only such as, but not limited to, the following:

perf_page_load_time_ms
perf_page_load_time_from_responsestart_ms
perf_first_contentful_paint_ms
perf_first_contentful_paint_from_responsestart_ms
js_pageload_execution_ms
http_page_open_to_first_received
javascript_gc_minor_time                                                                                              
gc_minor_us                                                                                                            
javascript_gc_total_time                                                                                              
gc_ms

Here are some answers for questions from the data publishing guideline:

Is the level of aggregation 3 or higher?

Yes, the aggregation level is 3. The aggregation will be done by OS and channel and will be aggregated by either submission date or build id. The bucket size will also be a much larger bucket size than 5,000. Ideally, we'd like to include data for up to 1 to 2 years so we can easily look back at the metric's history. Client id's, locale, or any other information will not be used.

Are there any Data Collection Category 3 (web activity) or 4 (highly-sensitive) dimensions?

No.

Do any of the dimensions or metrics include sensitive data?

No.

Are there any data included that do not have a corresponding data review for collection? Please link to relevant data review(s).

No. All data will be collected from glean metrics and will have already passed data reviews.

Comment 1

[Denis Palmeiro [:denispal]]

chutten, could you please help review this request for data publish? Thanks! Not sure if this was the correct component (maybe it should go to Core:Performance?), I just picked one that sounded appropriate.

Comment 2

[Chris H-C :chutten]

The necessary questions are correctly answered and there are no confounding factors inherent to the publishing of the data of which I'm aware.

You're good to go!

Comment 3

[Rob Miller [:rmiller]]

Did this dashboard get created? Trying to figure out if this ticket is still relevant...

Comment 4

[Rob Miller [:rmiller]]

Hello,

The Mozilla Data Engineering organization is currently going through our extensive backlog, consisting of hundreds of issues stretching back for nearly 10 years. We've done a pass through all of the open bugzilla bugs and have identified and tagged the ones that we think are relevant enough to still need attention. The rest, including the bug with which this comment is associated, we are closing as "WONTFIX" in a single bulk operation.

If you feel we have closed this (or any) issue in error, please feel free to take the following actions:

• Reopen the bug.
• Edit the bug to add the string [dataplatform] (including the brackets) to the Whiteboard field. (Note that you must edit the Whiteboard, not the similarly named QA Whiteboard.)

Doing this will ensure that we see the bug in our weekly triage process, where we will decide how to proceed.

Thank you.

Comment 5

[Denis Palmeiro [:denispal]]

Yes, it was created at performance.mozilla.org.