If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Make the FX_SESSION_RESTORE_NUMBER_OF_TABS_RESTORED and FX_SESSION_RESTORE_NUMBER_OF_WINDOWS_RESTORED probes opt-out

NEW
Unassigned

Status

()

Firefox
Session Restore
P3
normal
a year ago
a month ago

People

(Reporter: Dexter, Unassigned)

Tracking

(Blocks: 2 bugs)

Trunk
Points:
1
Dependency tree / graph

Firefox Tracking Flags

(firefox51 affected)

Details

(Whiteboard: [measurement:client])

(Reporter)

Description

a year ago
As per bug 1276200 comment 26, we should discuss making FX_SESSION_RESTORE_NUMBER_OF_WINDOWS_RESTORED and FX_SESSION_RESTORE_NUMBER_OF_TABS_RESTORED opt-out.

(In reply to brendan c from bug 1276200 comment #26)
> Thanks Alessio -- yes exactly, I was thinking of the window(s) that open
> when FF is first launched. Is FX_SESSION_RESTORE_NUMBER_OF_WINDOWS_RESTORED
> an opt-out metric, or will it be promoted to opt-out? It seems reasonable to
> differentiate the session restoration window open events from the count of
> window open events initiated by user action within a session, but we may
> want to be able to look at both; and actually, window hoarding across
> sessions is a quite informative and interesting behavior.
> 
> I'm still unclear on the process for whitelisting probes for gen-pop--
> rweiss thoughts?
(Reporter)

Updated

a year ago
Blocks: 1252625
Points: --- → 1
Priority: -- → P3
Whiteboard: [measurement:client]
(Reporter)

Comment 1

a year ago
> I'm still unclear on the process for whitelisting probes for gen-pop--
> rweiss thoughts?
Flags: needinfo?(rweiss)

Comment 2

a year ago
It's a "normal" data steward review, with enhanced scrutiny:

* what is the question that these metrics will be answering?
* who is responsible for analyzing or monitoring the results? (If necessary, need bugs filed to implement dashboarding and monitoring).
* do we already have automated tests for these measures?

rweiss can do that review if can provide that info. Or if rweiss is providing that info, I should probably do the review so that she's not reviewing her own proposal.

Comment 3

a year ago
And please let's file bugs in the feature component, not in the telemetry component.
Component: Telemetry → Session Restore
Product: Toolkit → Firefox

Comment 4

a year ago
:bsmedberg, you should probably provide the review.  I will answer as many questions as I can, and :bcolloran can follow up with additional details in case I am missing them.

1) We need to understand "window hoarding" as a user behavior.  Generally speaking, feature development such as Tab Center assert that management of tabs is more valuable to our users than management of windows.  This is an unsubstantiated claim.  We need to be able to compare the distribution of number of tabs compared to number of windows.

2) :bcolloran is the initial analyst who will be looking at these data. 

3) As for automated tests, I suspect :Dexter will have to answer those.
Flags: needinfo?(rweiss)
Flags: needinfo?(bcolloran)
Flags: needinfo?(alessio.placitelli)
(Reporter)

Comment 5

a year ago
(In reply to Rebecca Weiss from comment #4)
> 3) As for automated tests, I suspect :Dexter will have to answer those.

I'm afraid these probes don't have any test coverage. They were introduced by bug 1198898 [1]. If we promote these to opt-out, then we should be adding test coverage as part of this bug.

[1] - cset https://hg.mozilla.org/mozilla-central/rev/d6be25691040
Flags: needinfo?(alessio.placitelli)
(Reporter)

Comment 6

a year ago
(In reply to Alessio Placitelli [:Dexter] from comment #5)
> (In reply to Rebecca Weiss from comment #4)
> > 3) As for automated tests, I suspect :Dexter will have to answer those.
> 
> I'm afraid these probes don't have any test coverage. They were introduced
> by bug 1198898 [1]. If we promote these to opt-out, then we should be adding
> test coverage as part of this bug.
> 
> [1] - cset https://hg.mozilla.org/mozilla-central/rev/d6be25691040

I mean, if that's a requirement to promote the probe to opt-out.

Comment 7

a year ago
> 2) :bcolloran is the initial analyst who will be looking at these data.

word
Flags: needinfo?(bcolloran)
(Reporter)

Updated

a year ago
Blocks: 1305041
No longer blocks: 1252625
(Reporter)

Comment 8

11 months ago
(In reply to Benjamin Smedberg [:bsmedberg] from comment #2)
> It's a "normal" data steward review, with enhanced scrutiny:
> 
> * what is the question that these metrics will be answering?
> * who is responsible for analyzing or monitoring the results? (If necessary,
> need bugs filed to implement dashboarding and monitoring).
> * do we already have automated tests for these measures?

Benjamin, unfortunately these probes don't seem to have automated test coverage. Do we have to add tests before making the probes opt-out?
Flags: needinfo?(benjamin)

Comment 9

11 months ago
Are there reasons why we can't add the tests now? We could delay it if there's important blocking work (like Marionette) and it's an active/prioritized work item. But in general you need tests for data because we break them all the time by accident.
Flags: needinfo?(benjamin)
Blocks: 1330633
You need to log in before you can comment on or make changes to this bug.