1305500 - Lua filter for installations of new testpilot experiments

Status: RESOLVED FIXED

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Description

[Katie Parlante]

Breaking down https://bugzilla.mozilla.org/show_bug.cgi?id=1305155 into individual steps. This bug is for the lua filter.

Repeating:
Three testpilot experiments are launching on the 28th:
-Blok, id: [e-mail]
-min vid, id: [e-mail]
-page show: id: jid1-NeEaf3sAHdKHPA@jetpack

Installations of these studies are recorded and sent on a per-action basis through "doctype = testpilot" pings, which register both installations and uninstallations for specific studies in TxP.

For the launch date of these three studies, we are hoping to have a way to view the installation numbers in realtime, hopefully using a lua filter to examine these pings. We only need it for about a week on the 28th and following, after which out dau measurements will be sufficient.

ssuh's script calculating total installations (note: from when we were doing the changeover between two ping formats, so there's some extra logic in there that we won't need for the new tests, as listed above)
http://nbviewer.jupyter.org/urls/s3-us-west-2.amazonaws.com/telemetry-public-analysis-2/txp_install_counts/data/TxP%20Event-based%20Install%20Counts.ipynb

Comment 1

[Mike Trinkala [:trink]]

Code: https://gist.github.com/trink/36dd6289403be697072f29885cb9d934

Runtime Stats: https://pipeline-cep-aggregator.prod.mozaws.net/#plugins/filters/PrototypeSandbox-TestpilotInstallationCounts

Output: https://pipeline-cep-aggregator.prod.mozaws.net/data/PrototypeSandbox-TestpilotInstallationCounts..json