1479816 - Back fill new profiles table for all of 2017 so as to enable year over year comparisons

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, enhancement, P2)

Description

[George Kaberere [:gkaberere]]

The current version of the new profiles table in telemetry does not have back filled data for the first half of 2017 to allow installs. Bug is to backfill the data in new profiles table so as to allow year over year comparison of installs.

STMO Query: https://sql.telemetry.mozilla.org/queries/56823/source#148537
In the STMO query you will see that the cohort dates available are from 20170626 but are extremely low. More realistic numbers start in 20170809. We would like the data set to begin from 20170101.

Not being able to calculate year over year installs is making it difficult to understand changes in the acquisition tactics year over year. In addition due to the seasonality of the business, not having prior year comparisons results in lack of proper benchmarking.

Comment 1

[Mark Reid [:mreid]]

As I understand it, data from before about 2017-09 does not include data for new-profile pings[1]. That would mean that going further back in time would mean older cohorts from last year are not directly comparable with recent cohorts.

Anthony, can you comment on this? 


[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1351394

Comment 2

[Anthony Miyaguchi [:amiyaguchi]]

The new-profile ping was not added until Firefox 55 on August 8th as per [1][2].

While it might not be possible to benchmark against YoY data, seasonality can be accounted for in an A/B test setting. For example, comparing a control group against a campaign can provide some signal into the effectiveness of an acquisition tactic. 


[2] https://www.mozilla.org/en-US/firefox/55.0/releasenotes/