Add "shield-study" as an allowed value for docType in the Telemetry schema

RESOLVED FIXED

Status

Cloud Services
Metrics: Pipeline
P2
normal
RESOLVED FIXED
a year ago
11 months ago

People

(Reporter: dzeber, Assigned: whd)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

a year ago
Shield studies submit pings of type "shield-study".

Can we please add this to the telemetry schema for docType so that they are broken out of the OTHER bucket.

Comment 1

a year ago
can oyu take a quick look :whd?
Points: --- → 1
Flags: needinfo?(whd)
Priority: -- → P2
(Assignee)

Comment 2

a year ago
I'll deploy this by end of week.
Assignee: nobody → whd
Status: NEW → ASSIGNED
Flags: needinfo?(whd)
(Assignee)

Comment 3

a year ago
https://github.com/mozilla-services/puppet-config/pull/2425

This has been deployed, from UTC Dec. 15 forward the data should no longer be in the OTHER bucket.
Status: ASSIGNED → RESOLVED
Last Resolved: a year ago
Resolution: --- → FIXED
(Assignee)

Comment 4

11 months ago
This change only affects data from the 15th forward. Since the deploy occured on the 15th, data is in both the OTHER and shield-study buckets for that day, so here's how you might get all the pings (python):

  submissionDate = "20161215"
  dataset = Dataset.from_source("telemetry").where(submissionDate=submissionDate)
  pings = dataset.where(docType='OTHER').records(sc, sample=1).filter(lambda p: p.get('type') == 'shield-study')
  pings2 = dataset.where(docType='shield_study').records(sc, sample=1)
  (pings + pings2).collect()

You should use the former records() call for days preceding and the latter for days succeeding.
You need to log in before you can comment on or make changes to this bug.