527831 - QA First Run Test (SiteSpect)

Status: RESOLVED FIXED

(www.mozilla.org :: General, defect)

Description

[Blake Cutler]

We are testing the new 3.6 First Run page on current 3.5 users.  We have slightly modified the copy--changing "Roll over to try, click to apply" to "30,000 themes for Firefox."  

You can access the experimental variation here: https://sitespect.mozilla.com:9443/Variation_One?Site_ID=2&Variation_ID=736&Factor_ID=20&Copy=0

Thanks.

Comment 1

[Stephen Donner [:stephend] Not actively reading bugmail]

If this is literally only changing text (no CSS, no JS), then I don't feel we need to QA this; SiteSpect's functionality has been already shown to work.

Is there concern because it's live 3.5 users?

Comment 2

[Blake Cutler]

There are quite a few places I could have made a mistake.  Would like to QA the page, if it's not too much trouble.   

Has https://www-3.6.stage.mozilla.com/en-US/firefox/3.6/firstrun/index.html gone though QA yet?

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

Attachment: Screenshot

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

I'm missing CSS -- do you see this in your testing, Blake?

Comment 5

[Blake Cutler]

I don't.  I'm currently linking to the CSS in staging.  We'll need to move those files to mozilla.com before running the test.  

At this point, I think we should wait until I'm back on Monday before running the test.  Thanks for looking at the page so quickly.

Comment 6

[Blake Cutler]

Okay, the test is ready to QA.  Only Firefox users will see the experimental variation.

Comment 7

[Stephen Donner [:stephend] Not actively reading bugmail]

Blake, could you (last time, sorry) re-paste the HOSTS-file config changes needed to test this?  I'll put them up on our tips & tricks page; thanks!

Comment 8

[Blake Cutler]

Sure, they are:

63.245.209.10 sitespect.mozilla.com
63.245.209.10 www.mozilla.com

I should note that only users with "Firefox/3.5.5" in their user-agent string will see this test.  Hopefully this makes your life a little easier.

Comment 9

[raymond [:retornam] (inactive)]

verified fixed on http://www.mozilla.com:9081/en-US/firefox/3.5.5/firstrun/index.html 
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729) 
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.5) Gecko/20091102  Ubuntu/9.04 (jaunty) Firefox/3.5.5

Comment 10

[Blake Cutler]

I have one more page I need to QA for this test.  Under the "Factors & Variations" tab, it is "Variation: A Variation" in "Factor: First Run A/B Test."  

I copied and pasted the control page code and added tracking elements, so there should not be any issues.  Again, only Firefox 3.5.5 users will see this variation.

Thanks!

Comment 11

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to comment #10)

I just checked it out; looks good to me.

Comment 12

[Blake Cutler]

Thanks Stephen!  I'll likely need to QA one more iteration of this page next week (or tomorrow).  Should I open a new bug or file a new comment?

Comment 13

[Stephen Donner [:stephend] Not actively reading bugmail]

New bug, please.  Also, more of a heads-up would be nice, thanks.