1208658 - Suggested Tile Funnelcake Build for Firefox 44

Status: RESOLVED INCOMPLETE

(Release Engineering :: Release Requests, defect)

Description

[Francesco Polizzi [:fpolizzi]]

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:40.0) Gecko/20100101 Firefox/40.0
Build ID: 20150826023504

Steps to reproduce:

We are looking to create two new builds of Firefox (release-cck-mozilla54 and release-cck-mozilla55) with the following features:

Funnelcake 54: Full installer build of Firefox with no changes that includes sponsored tiles.

Funnelcake 55: Full installer build of Firefox with suggested tiles disabled (setting browser.newtabpage.enhanced flag to FALSE)

I will create the config files, at which time, we will need the builds created.

Additional meta information about the hypothesis can be found here: https://bugzilla.mozilla.org/show_bug.cgi?id=1199441.

Comment 1

[Francesco Polizzi [:fpolizzi]]

Pull request submitted for configs.

Comment 2

[Shane Caraveo (:mixedpuppy)]

(In reply to Francesco Polizzi [:fpolizzi] from comment #1)
> Pull request submitted for configs.

one small comment on the pull request

Comment 3

[Francesco Polizzi [:fpolizzi]]

Configs merged. Nick, any chance you can spin up a build in 41.0.1?

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Builds uploaded to 
  http://archive.mozilla.org/pub/mozilla.org/firefox/candidates/41.0.1-candidates/build2/partner-repacks-bug1208658/

RelEng TODO - bouncer setup, publish builds after signoff

Comment 5

[Francesco Polizzi [:fpolizzi]]

It appears as though build 55 is not working as expected in its current form, as it still shows suggested tiles. Shane, is it possible that the preference is marked incorrectly in the config file (https://github.com/mozilla-partners/funnelcake/blob/master/desktop/funnelcake55/distribution/distribution.ini#L13)?

Comment 6

[Shane Caraveo (:mixedpuppy)]

(In reply to Francesco Polizzi [:fpolizzi] from comment #5)
> It appears as though build 55 is not working as expected in its current
> form, as it still shows suggested tiles. Shane, is it possible that the
> preference is marked incorrectly in the config file
> (https://github.com/mozilla-partners/funnelcake/blob/master/desktop/
> funnelcake55/distribution/distribution.ini#L13)?

Can you install/run it with a clean profile and see what the pref is set to?

Comment 7

[Francesco Polizzi [:fpolizzi]]

Attachment: Screen Shot 2015-10-07 at 11.55.13 AM.png

Looks like the pref is still set to true.

Comment 8

[Shane Caraveo (:mixedpuppy)]

Ok, looks like there is a new "sticky_pref" and we cannot override it in a normal fashion, I'll have to look into this further.

Comment 9

[Shane Caraveo (:mixedpuppy)]

Rather than trying to dig through everything, we'll wait for @markh this evening and see if he has any input.

Comment 10

[Shane Caraveo (:mixedpuppy)]

After some discussion on #fx-team and digging further anyway, the conclusion is you will not be able to funnelcake test this pref until something is changed in Firefox.  You could test with browser.newtabpage.enabled=false but I don't know if that would get you what you are looking for.

Comment 11

[Shane Caraveo (:mixedpuppy)]

I've at least traced this down to a bug in 41, the problem is not reproducible in a repack of 42.0b4.

Comment 12

[Francesco Polizzi [:fpolizzi]]

(In reply to Shane Caraveo (:mixedpuppy) from comment #11)
> I've at least traced this down to a bug in 41, the problem is not
> reproducible in a repack of 42.0b4.

Interesting, so we will most likely need to wait until 42 releases to build/ QA/ release this, I presume.

Comment 13

[Shane Caraveo (:mixedpuppy)]

Yes, it will have to wait for 42.

Comment 14

[Chris More [:cmore]]

Let's wait for Firefox 44 to perform this test. Too many tests going on in Firefox 42 and Firefox 43 is too close to the holiday and that will mess up my retention analysis. It is the only time of the year that it looks like we churn users higher than average, because people are on vacation.

That means we'll need configs for Firefox 44 release and we'll do this in January 2016.

Comment 15

[Nick Thomas [:nthomas] (UTC+12)]

Please reopen if this is still an active plan.