Closed Bug 986530 Opened 8 years ago Closed 8 years ago

Deploy a test experiment to the nightly population


(Firefox Health Report Graveyard :: Client: Desktop, defect)

Not set


(firefox32 verified)

Tracking Status
firefox32 --- verified


(Reporter: benjamin, Unassigned)



(Whiteboard: p=0 s=it-32c-31a-30b.1 [qa!])

We want to deploy a test experiment to nightly users primarily to make sure that the experiment system is working properly. It will have the following characteristics:

* The addon will be
* This changes the frecency ordering of tiles in the about:newtab page, which is something we've already measured using telemetry.
* We want to deploy with a 25% sample to make sure that sampling works reasonably
* Also want to ship with a jsfilter to make sure the filtering and logging works: I suggest a filter that checks the FHR payload and rejects the install if either of the following addons is active:
** tree style tabs ""
** classic theme restorer "ClassicThemeRestorer@ArisT2Noia4dev"

Note: I'm not excluding those because they are bad, just because some nightly users use them and so they make a reasonable test.

Not sure whether to block this on bug 985084; it would be nice to get a better test of that code in the field.
Assignee: nobody → isegall
Assignee: isegall → nobody
Depends on: 988873
Depends on: 985084
Depends on: 975000
Whiteboard: p=0
No longer blocks: fxdesktopbacklog
Flags: firefox-backlog+
Whiteboard: p=0 → p=8
Whiteboard: p=8 → p=2
Heh, this happened.
Closed: 8 years ago
Resolution: --- → FIXED
Whiteboard: p=2 → p=0 s=it-32c-31a-30b.1 [qa?]
Whiteboard: p=0 s=it-32c-31a-30b.1 [qa?] → p=0 s=it-32c-31a-30b.1 [qa+]
Went through verification with the latest Nightly build from the following location:

- Downloaded the latest Nightly build and ensured "experiments.enabled;true" by default
- Changed "experiments.force-sample-value;0.25" and ensured that the experiment was installed without any issues
- Ensured that "Active:true" under "Experimental Features" in about:support (ensured name, id, description, active and end date were listed)
- Ensured that the "Experiments" container appeared under about:addons and worked without any issues
- Ensured that the "Experiments" container included the latest nightly experiment
- Ensured that the experiment wasn't added into the extensions.bootstrappedAddons quick access cache
- Went through the above test cases using Windows, OSX and Ubuntu
Whiteboard: p=0 s=it-32c-31a-30b.1 [qa+] → p=0 s=it-32c-31a-30b.1 [qa!]
Product: Firefox Health Report → Firefox Health Report Graveyard
You need to log in before you can comment on or make changes to this bug.