1947604 - Instrument duplicate metrics for client-side sampling experiment

Status: RESOLVED FIXED

(Data Platform and Tools :: Glean: SDK, task, P1)

Description

[Travis Long [:travis_]]

In order to test, measure, and evaluate using client-side sampling to reduce the costs of GLAM, the following metrics have been chosen to instrument in duplicate with a side-by-side metric that is disabled by default. We will then use a Nimbus rollout to enable these metrics for a similar percentage of the population that use for server-side sampling of GLAM data.

The metrics proposed for side-by-side instrumentation are from different segments of the population to ensure low reporting metrics are as reliable as high reporting metrics, and include 2 timing distributions and 2 counters from each segment.

The initial metrics that have been selected include:

Low population:

• power.cpu_time_bogus_values
• javascript.pageload.protect_time
• networking.http_content_html5parser_ondatafinished_to_onstop_delay
• networking.os_socket_limit_reached

Med population:

• network.sub_complete_load_net
• downloads.panel_shown
• pdfjs.used
• performance.pageload.async_sheet_load

High population:

• perf.largest_contentful_paint
• browser.engagement.active_ticks
• performance.clone.deserialize.time
• power.total_cpu_time_ms

I will begin reaching out to owners of these metrics to ensure that there will be no problems with our adding parallel instrumentation before proceeding, and will use this bug to track progress and patches related to implementation.

Comment 1

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 1: Glam Experiment temporary metric instrumentation (browser module). r=janerik

Comment 2

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 2: Glam Experiment temporary metric instrumentation (process tools component). r=janerik

Comment 3

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 3: Glam Experiment temporary metric instrumentation (netwerk module). r=janerik

Comment 4

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 4: Glam Experiment temporary metric instrumentation (pdfjs component). r=janerik

Comment 5

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 5: Glam Experiment temporary metric instrumentation (dom module). r=janerik

Comment 6

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 6: Glam Experiment temporary metric instrumentation (js module). r=janerik

Comment 7

[Travis Long [:travis_]]

Attachment: Bug 1947604 - Part 7: Glam Experiment temporary metric instrumentation (layout module). r=janerik

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/65951bf967b3
Part 1: Glam Experiment temporary metric instrumentation (browser module). r=janerik
https://hg.mozilla.org/integration/autoland/rev/e29df49cdf1f
Part 2: Glam Experiment temporary metric instrumentation (process tools component). r=janerik
https://hg.mozilla.org/integration/autoland/rev/eed3e860c918
Part 3: Glam Experiment temporary metric instrumentation (netwerk module). r=janerik,necko-reviewers
https://hg.mozilla.org/integration/autoland/rev/df22611a161e
Part 4: Glam Experiment temporary metric instrumentation (pdfjs component). r=janerik
https://hg.mozilla.org/integration/autoland/rev/bbfefe32a73e
Part 5: Glam Experiment temporary metric instrumentation (dom module). r=janerik
https://hg.mozilla.org/integration/autoland/rev/45de0392478a
Part 6: Glam Experiment temporary metric instrumentation (js module). r=janerik
https://hg.mozilla.org/integration/autoland/rev/070fb1c95dc9
Part 7: Glam Experiment temporary metric instrumentation (layout module). r=janerik

Comment 9

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/65951bf967b3
https://hg.mozilla.org/mozilla-central/rev/e29df49cdf1f
https://hg.mozilla.org/mozilla-central/rev/eed3e860c918
https://hg.mozilla.org/mozilla-central/rev/df22611a161e
https://hg.mozilla.org/mozilla-central/rev/bbfefe32a73e
https://hg.mozilla.org/mozilla-central/rev/45de0392478a
https://hg.mozilla.org/mozilla-central/rev/070fb1c95dc9