1828666 - Extend data retention for Focus Android and Klar Android from 180 to 760 days.

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement, P1)

Description

[Mark Reid [:mreid]]

760 days is roughly 25 months, and would let us compute two year-over-year comparisons for DAU KPIs.

Comment 1

[Mark Reid [:mreid]]

Attachment: data-review-bug1828666.txt

Comment 2

[Chris H-C :chutten]

Comment on attachment 9329056 [details]
data-review-bug1828666.txt

Data Stewardship isn't equipped to weigh in on this. Changing the retention period isn't a criteria for data collection we consider (we concern ourselves with how long the data is collected, not how long we choose to store it). Nice use of the renewal form, though.

Put another way: Data Stewardship isn't gonna stop you here. You're good to go on the Stewardship front: the data being collected is as data-r+ as it's always been.

Opinion Time: the people you might want to ask (and may have already) are the people who chose 180 in the first place. Why did they not choose the default? (add it to the list of reasons we need a better retention default) Why did they choose 180 instead of 760? (maybe they just didn't consider YoY analyses, maybe they had a deeper requirement).

Comment 3

[Mark Reid [:mreid]]

Thanks!

(In reply to Chris H-C :chutten from comment #2)

Opinion Time: the people you might want to ask (and may have already) are the people who chose 180 in the first place. Why did they not choose the default? (add it to the list of reasons we need a better retention default) Why did they choose 180 instead of 760? (maybe they just didn't consider YoY analyses, maybe they had a deeper requirement).

Good idea! Amedyne, can you think of any reasons not to extend the data retention period for the Focus / Klar data? From the original bug, it sounds like it was fine to revisit in the future.

Comment 4

[Chris H-C :chutten]

Attachment: pr 586: Bug 1828666 - Extend retention for Focus Android and Klar Android

Comment 5

[Amedyne Moya [:amoya]]

:mreid This was the change that introduced Focus to the probe-scraper. https://github.com/mozilla/probe-scraper/commit/dd9916c96333195b2090dabd8022412c1dd510cb
However I do not have history why it was set to 180 days. Maybe it was a copy-paste error or an assumption(?).
Anyway, I see the value of doing a YOY analyses, so I do not have any concerns changing this to 760.

Comment 6

[Chris H-C :chutten]

chutten merged PR #586: "Bug 1828666 - Extend retention for Focus Android and Klar Android" in 0dcdba3.

Comment 7

[Mark Reid [:mreid]]

I checked the org_mozilla_focus.baseline and it is no longer expiring after 180d. Thanks all!