1199681 - Waffle flag for Optimizely on Windows 10 /welcome/ page

Status: RESOLVED FIXED

(www.mozilla.org :: Analytics, defect)

Description

[Gareth Cull [:garethc]]

Hi,

We are having some problems rendering a page within Optimizely as the script currently isn't on the /welcome/ page. Can we turn on the waffle flag for Optimizely on this page?

When we bring this page into Optimizely (without the script) it only shows the primary headline and supporting copy, and nothing beneath it (http://cl.ly/image/130f1H0b1W0H).

Optimizely Support said this issue may be due to the following:

"It appears this is how the site responds to be loaded via a proxy (compatibility mode). Sites load in compatibility mode when the snippet is missing from the page or blocked by the browser. According to the diagnostic report (Options > Diagnostic Report), the snippet isn't yet implemented on page. I also noticed in the error console that the X-Frame-Options header is set to 'Deny'.

First, we need to implement the snippet on the page, then we need to modify the X-Frame-Options so that the site will load in the editor normally. We can do this two ways; either by creating an 'Allow-From' exception for 'optimizely.com', or using an add-on that will temporarily modify this setting. I've linked to resources for both below.

https://developer.mozilla.org/en-US/docs/Web/HTTP/X-Frame-Options

https://addons.mozilla.org/en-Us/firefox/addon/ignore-x-frame-options/"

Comment 1

[Jennifer Bertsch [:jbertsch]]

Thanks for following up on this, Gareth.  Adding jpetto and jgmize to the bug so that we can keep moving forward.

Comment 2

[Jonathan Petto [:jpetto]]

It looks like Optimizely is prepped to be included on the template:

https://github.com/mozilla/bedrock/blob/master/bedrock/firefox/templates/firefox/win10-welcome.html#L23

Waiting on jgmize to verify the waffle switch is on.

I haven't seen X-Frame-Options problems on other Optimizely experiment previews, so hoping just enabling the switch will do the trick. If not, we'll investigate further.

Comment 3

[Chris More [:cmore]]

I've added a placeholder to the wiki page for this switch.

https://wiki.mozilla.org/Mozilla.org/Optimizely

jpetto: can you add the switch name to the wiki page at the bottom?

Comment 4

[Jonathan Petto [:jpetto]]

:jmize just turned the switch on in prod. Wiki has been updated.

:garethc - Update the bug if you are still having X-Frame troubles in Optimizely.

Comment 5

[Gareth Cull [:garethc]]

Hey Jon,

I just tried to view the experiment in Optimizely and it still isn't showing the conditional content below the Headline. 

Can you please check into seeing if this is an X-Frame issue or what else could be causing this? 

Gareth

Comment 6

[Alex Gibson [:agibson]]

All the content on this page below the main headline and subhead is dependent on UITour. Gareth, could this be a case that it's not set up properly in whatever browser you're testing on?

Comment 7

[Jennifer Bertsch [:jbertsch]]

What are our next steps here?

Comment 8

[Gareth Cull [:garethc]]

Hey Alex,

I've created a fresh profile with all of the default settings and am still having problems. It seems like we should set up our own custom a/b test outside of Optimizely for this page. 

Here's a preview link to see how its rendering: 
https://www.optimizelypreview.com/https://www.mozilla.org/en-US/firefox/windows-10/welcome/?optimizely_snippet=s3-246059135&optimizely_show_preview=true&optimizely_token=736be47907fa79febcd9d60c44a9ac2e&optimizely_x3389970197=0

Can you please take a look at this and see what the error could be?

Thanks.

Gareth

Comment 9

[Alex Gibson [:agibson]]

(In reply to Gareth Cull [:garethc] from comment #8)
> Hey Alex,
> 
> I've created a fresh profile with all of the default settings and am still
> having problems. It seems like we should set up our own custom a/b test
> outside of Optimizely for this page. 
> 
> Here's a preview link to see how its rendering: 
> https://www.optimizelypreview.com/https://www.mozilla.org/en-US/firefox/
> windows-10/welcome/?optimizely_snippet=s3-
> 246059135&optimizely_show_preview=true&optimizely_token=736be47907fa79febcd9d
> 60c44a9ac2e&optimizely_x3389970197=0
> 
> Can you please take a look at this and see what the error could be?
> 
> Thanks.
> 
> Gareth

Hi Gareth,

UITour only works on white-listed domains for security reasons, hence when you preview it through a domain such as https://www.optimizelypreview.com, it will not work by default. 

I would be happy to run you through how to set this up locally for testing, it just requires some additional preferences adding to about:config.

Feel free to ping me on IRC anytime and we can take 5 mins to run through it.

Thanks

Comment 10

[Gareth Cull [:garethc]]

Thanks for taking the time to look at this with me Alex. 

We managed to get this working in Optimizely's preview mode by adding the following domains to browser.uitour.testingOrigins in about:config:
-- https://app.optimizely.com, https://www.optimizelypreview.com

However, we couldn't get the page to render properly within Optimizely. I'm going to try and make some changes in Optimizely and see if they appear in preview mode. However, I feel like we may need to run this test outside of Optimizely. I'll update the bug after I've tested out some changes in Optimizely. Thanks.

Comment 11

[Alex Gibson [:agibson]]

Closing this bug for now, as the issue is not related to either waffle or the optimizely snippet on the page. If we need to do any manual tests outside of Optimizely for this page, we can open a new bug. Thanks, Gareth!