Report true as well as false dummy prefs via telemetry to verify prefs are being set correctly

RESOLVED FIXED in Firefox 64



7 months ago
7 months ago


(Reporter: cpearce, Assigned: cpearce)


(Blocks 1 bug)

Firefox 64
Dependency tree / graph

Firefox Tracking Flags

(firefox64 fixed)



(2 attachments)

We suspect Normandy Pref Experiments aren't correctly setting or reporting that they've set prefs. In bug 1499552 I added a default pref with value false for us to set via a Pref Experiments, but I think we should also have a pref with default true to set via the dummy Pref Experiment.

We're seeing about a 25% failure rate in the Pref Experiment, so maybe one of these four cases isn't working as expected?

So we should add another default pref with a default value of true so we can set that via a dummy Pref Experiment.

Comment 1

7 months ago
The Webrender Pref Experiment is reporting its pref via telemetry and that is
reporting a different value than what the Normandy experiments telemetry
indicates should be being seen.

In Bug 1499552 I added a pref and telemetry reporting in preparation for running
a dummy Pref Experiment to verify that prefs set are reported as set, but I
realised I missed a case; where there's an existing default pref set,
we're only covering the case where that default pref has value false. We're seeing
a ~25% failure rate in the pref reporting. So we should cover the other three cases
in the dummy Pref Experiment, just in case it's one of these four cases that
is failing.

So here I add another dummy pref with a default value of true, and I report that
via telemetry. I rename the pref I added yesterday to make things consistent.

Comment 2

7 months ago
I realised the data collection I requested yesterday in bug 1499552 missed a case, so requesting a second pref to be collected.
Attachment #9018406 - Flags: review?(francois)
Comment on attachment 9018406 [details]
Data collection request

The changes in this bug do not change any of the answers in the original data review:
Attachment #9018406 - Flags: review?(francois) → review+

Comment 4

7 months ago
Pushed by
Add dummy pref with default value true, report via telemetry. r=mythmon

Comment 5

7 months ago
Last Resolved: 7 months ago
Resolution: --- → FIXED
Target Milestone: --- → Firefox 64
Blocks: 1500230


7 months ago
Depends on: 1502779

Comment 6

7 months ago
Since our study has concluded, I backed out this telemetry in bug 1502779.
You need to log in before you can comment on or make changes to this bug.