519851 - Personas & EdgeCast CDN

Status: VERIFIED FIXED

(Websites Graveyard :: getpersonas.com, defect, P1)

Description

[matthew zeier [:mrz]]

Want to push persona images and json file to EdgeCast.  To keep namespace separate I want to use something like getpersonas-cdn.mozilla.net. 

I'll let Ryan comment on his ideas on URL constructs.

Need to include cache headers on json & image files.

Comment 1

[matthew zeier [:mrz]]

oremj, did I set it up right at EdgeCast?  

Also pushed 

getpersonas-cdn.mozilla.net IN CNAME wac.1237.edgecastcdn.net. 

out.

Comment 2

[matthew zeier [:mrz]]

Ping backs shouldn't go to the CDN, don't want to screw with log processing.

Comment 3

[Ryan Doherty (:rdoherty)]

My absolute ideal url construct would be:
cdn.mozilla.net/http://www.getpersonas.com/static/img1.png, etc. This would allow getpersonas.com to simply create the url and EdgeCast can fetch it.

Second choice would be something like:
personas-cdn.mozilla.net/static/img1.png, etc (mimick directory structure of getpersonas.com) EdgeCast would still fetch from www.getpersonas.com.

Talked with Matthew, getpersonas.com would be the origin server EdgeCast pulls from, we would not push our content to them.

I'm assuming EdgeCast respects cache and expires headers that we'll set on getpersonas.com?

Comment 4

[Ryan Doherty (:rdoherty)]

Note: since these images will be shown on AMO, we will need the CDN to have SSL.

Comment 5

[matthew zeier [:mrz]]

(In reply to comment #4)
> Note: since these images will be shown on AMO, we will need the CDN to have
> SSL.

This breaks using EdgeCast - they won't be able to scale the to AMO-like load and do SSL.

Comment 6

[matthew zeier [:mrz]]

I got clarification on how the AMO experience will be.  Users casually browsing AMO for themes should pull from some SSL url that we host.  

Users using the in-product feature will hit getpersonas.com.  That doesn't need to be SSL.

Comment 7

[Ryan Doherty (:rdoherty)]

Extra requirement: we will need to stage these changes so we'll need a different CDN url for stage images and assets. Assets will be pulled from http://sm-personas01.mozilla.org.

Comment 8

[matthew zeier [:mrz]]

Back on track, re-opening.

Comment 9

[Ryan Doherty (:rdoherty)]

Booyah!

Comment 10

[Stephen Donner [:stephend] Not actively reading bugmail]

mrz: any idea when we might try this?  Guessing not until early next year?

Comment 11

[matthew zeier [:mrz]]

Pushing over to oremj - he'll set timelines for this.

Comment 12

[Jeremy Orem [:oremj]]

For staging you'll use "getpersonas-stage-cdn.mozilla.net" and production will be "getpersonas-cdn.mozilla.net". 

Ex: http://getpersonas-stage-cdn.mozilla.net/static/img/logo.png

Edgecast honors cache-control and expiration headers, so you'll need to set those for however long you want the images to be cached.

Do you need anymore information?

Comment 13

[Jeremy Orem [:oremj]]

Assigning to Ryan for implementation.

Comment 14

[Ryan Doherty (:rdoherty)]

(In reply to comment #12)
> Do you need anymore information?

I think that's all I need, thanks!

Comment 15

[Ryan Doherty (:rdoherty)]

Jeremy: setting cache-control headers will be easiest if .htaccess files are allowed for stage & production (currently they aren't). Can we do this?

Comment 16

[Ryan Doherty (:rdoherty)]

r58705 adds personas cdn for persona images.

Comment 17

[Jeremy Orem [:oremj]]

On zlb-stage01 I've added the following trafficscript to the personas vservers:

if( http.getcookie( "PERSONA_USER" ) != "" ){
   http.cache.disable();
}

That will also need to be added to the production vservers when we are ready to turn this on.

Comment 18

[Jeremy Orem [:oremj]]

Oops, closed the wrong bug. Reopening in case it wasn't actually fixed.

Comment 19

[Stephen Donner [:stephend] Not actively reading bugmail]

Something strange: while the preview images work in the browser, they appear to be malformed, and cause 404 errors to be thrown:

http://sm-personas01.mozilla.org/static/1/8/21118/preview.jpg

GET /static/1/8/21118/preview.jpg HTTP/1.1
Host: sm-personas01.mozilla.org
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6
Accept: image/png,image/*;q=0.8,*/*;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Referer: http://sm-personas01.mozilla.org/en-US/persona/810
Cookie: __utma=150903082.1807176038.1262250023.1262250023.1262250023.1; __utmz=150903082.1262250023.1.1.utmccn=(referral)|utmcsr=mozilla.com|utmcct=/en-US/|utmcmd=referral; s_vsn_mozillaaddonsorg_1=6823189617192; __unam=f7237fc-125e58e68d5-230c8c1-4; installed-persona=810

HTTP/1.x 404 Not Found
Date: Mon, 04 Jan 2010 04:42:53 GMT
Server: Apache/2.2.3 (CentOS)
Content-Length: 316
Connection: close
Content-Type: text/html; charset=iso-8859-1

Comment 20

[matthew zeier [:mrz]]

This bug summary suggests the error is with EdgeCast but sm-personas01 resolves to a Mozilla IP address, not EdgeCast.

Comment 21

[Stephen Donner [:stephend] Not actively reading bugmail]

Yeah; I think it's just fallout from r58705 in comment 16 -- I know it's not an EdgeCast problem.

http://getpersonas-stage-cdn.mozilla.net/static/img/logo.png, for example, works fine.

Comment 22

[Ryan Doherty (:rdoherty)]

(In reply to comment #19)
> Something strange: while the preview images work in the browser, they appear to
> be malformed, and cause 404 errors to be thrown:
> 
> http://sm-personas01.mozilla.org/static/1/8/21118/preview.jpg

Seems like that one persona is broken or missing, I checked a few other personas and they are working via the cdn hostname.

If we noticed a problem we can open a separate bug for it.

Comment 23

[Stephen Donner [:stephend] Not actively reading bugmail]

Verified FIXED on http://personas.stage.mozilla.com/en-US/; I'll file new bugs related to this as I see them (if I see them).