649813 - Fix top 404 errors

Status: RESOLVED FIXED

Description

[Anthony Ricaud (:rik)]

From this list:

count   domain          url
44885   www.mozilla.com    /en-US/img/tignish/gettingstarted/sites-universia.png
43955   www.mozilla.com    /en-US/img/tignish/gettingstarted/sites-forecastfox.png
40673   www.mozilla.com    /en-US/img/tignish/gettingstarted/sites-meebo.png
15597   www.mozilla.com    /en-US/style/covehead/all-older.css
13253   www.mozilla.com    /en-US/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
12569   www.mozilla.com    /en-US/img/tignish/gettingstarted/sites-medium.png
12111   www.mozilla.com    /en-US/js/mobile-nav.js
8534    www.mozilla.com     /en-US/img/tignish/gettingstarted/sites-FIXME.png
6770    www.mozilla.com     /en-US/img/fonts/MetaWebPro-Black.woff')%20format('woff
5134    www.mozilla.com     /en-US/img/tignish/about/icon-get-involved.png
5012    www.mozilla.com     /en-US/img/tignish/about/icon-careers.png
4969    www.mozilla.com     /pt-BR/img/tignish/gettingstarted/sites-universia.png
4886    www.mozilla.com     /pt-BR/img/tignish/gettingstarted/sites-forecastfox.png
4852    www.mozilla.com     /en-US/img/tignish/about/icon-partnerships.png
4737    www.mozilla.com     /en-US/img/tignish/about/icon-licensing.png
4649    www.mozilla.com     /ja/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
4602    www.mozilla.com     /en-US/img/tignish/about/icon-blog.png
4491    www.mozilla.com     /en-US/img/tignish/about/icon-store.png
4478    www.mozilla.com     /pt-BR/img/tignish/gettingstarted/sites-meebo.png
4265    www.mozilla.com     /en-US/img/tignish/about/icon-contact.png
4059    www.mozilla.com     /en-US/img/tignish/about/icon-logo.png
2897    www.mozilla.com     /en-US/img/covehead/divider-main.png
2871    www.mozilla.com     /en-US/img/tignish/gettingstarted/FIXME.png
2760    www.mozilla.com     /de/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
2232    www.mozilla.com     /es-ES/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
2106    www.mozilla.com     /ja/img/fonts/MetaWebPro-Black.woff')%20format('woff
2066    www.mozilla.com     /zh-CN/img/fonts/MetaWebPro-Black.woff')%20format('woff
2044    www.mozilla.com     /ar/img/tignish/gettingstarted/sites-medium.png
2017    www.mozilla.com     /fr/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1756    www.mozilla.com     /ru/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1635    www.mozilla.com     /pt-BR/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1570    www.mozilla.com     /en-US/newsletter/%7B$config%5B%27static_prefix%27%5D%7D/js/autofocus.js
1259    www.mozilla.com     /nl/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1228    www.mozilla.com     /tr/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1213    www.mozilla.com     /en-GB/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1128    www.mozilla.com     /zh-TW/img/fonts/MetaWebPro-Black.woff')%20format('woff
1064    www.mozilla.com     /en-GB/js/mobile-nav.js
1042    www.mozilla.com     /it/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
1040    www.mozilla.com     /en-GB/style/covehead/all-older.css
1012    www.mozilla.com     /zh-TW/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
934     www.mozilla.com      /en-US/firefox/firefox.exe
930     www.mozilla.com      /de/img/fonts/MetaWebPro-Black.woff')%20format('woff
929     www.mozilla.com      /ru/img/fonts/MetaWebPro-Black.woff')%20format('woff
926     www.mozilla.com      /id/img/tignish/gettingstarted/sites-FIXME.png
884     www.mozilla.com      /fr/img/fonts/MetaWebPro-Black.woff')%20format('woff
882     www.mozilla.com      /pl/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
794     www.mozilla.com      /zh-CN/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
748     www.mozilla.com      /ru/js/mobile-nav.js
731     www.mozilla.com      /es-ES/js/mobile-nav.js
723     www.mozilla.com      /fa/img/tignish/gettingstarted/sites-medium.png
698     www.mozilla.com      /es-ES/img/fonts/MetaWebPro-Black.woff')%20format('woff
691     www.mozilla.com      /ar/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
630     www.mozilla.com      /en-US/firefox/new/data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAMAAAAwCAMAAADjGDCOAAAAElBMVEXq6urAwMDBwcHp6en29vb///+NcJSLAAAAPElEQVQI12WOwQ0AMQzCTAL7r9zfXZM+LUsGLHA1SUiCq7G4GKzfJ8FqXEzWaowmyzM31O+Hm9fHr1F9AMllAhxqMpx9AAAAAElFTkSuQmCC
623     www.mozilla.com      /en-US/firefox/new/data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAMAAAAwBAMAAAAm6N2PAAAAAXNSR0IArs4c6QAAABJQTFRF////6urqwMDAwcHB6enp9vb2pJTqkQAAAAF0Uk5TAEDm2GYAAAA2SURBVAjXYwgSYAh2YIAAIAPIhbIFGIJg4kAAZAcLINhBSFoQ2pG0gNhI6oOxqUe2GqIl2AEAZS8MDwFO6nAAAAAASUVORK5CYII=
620     www.mozilla.com      /en-US/firefox/new/data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAcAAAASCAMAAACglzTJAAAAS1BMVEXv9/70+v7x+f73/P/y+P/x+P/w+P72+v/s9v/v9//1+v/y+v/y+f7v+P7v+P/g8f34/P/3+//y+f/g8f7h8f7g8P3t9//s9//s9v4Izr2eAAAAX0lEQVQI1wXBwQrCQBBEwde9cwioIRfx//8w6GFhDdOp0ptGnAUS2d2IlWUR8LIC1cP5E+sqb5HOh/igZvklYv3GesaovLcaMEZpXB3h7/AG6vIMCrMQoOGjSZi+aEncnN0pTtnMDPsAAAAASUVORK5CYII=
574     www.mozilla.com      /es-MX/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
569     www.mozilla.com      /pt-BR/img/tignish/about/icon-get-involved.png
556     www.mozilla.com      /es-ES/style/covehead/all-older.css
556     www.mozilla.com      /pt-BR/img/tignish/about/icon-careers.png
556     www.mozilla.com      /zh-TW/img/fonts/MetaWebPro-Bold.woff')%20format('woff
540     www.mozilla.com      /
535     www.mozilla.com      /nl/img/fonts/MetaWebPro-Black.woff')%20format('woff
535     www.mozilla.com      /en-US/firefox/3.6.16/whatsnew/data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABkAAAAQCAMAAADUOCSZAAAAM1BMVEU4AADB2fjv9f2SvPSpy/bg7Pyxz/eawfS51PiixvXY5/vJ3vn3+v7Q4vro8f2Kt/ODs/LKfzhhAAAAAXRSTlMAQObYZgAAAHZJREFUGNNt0EESgCAIBVBMzSyVf//TBrJpIDbO8AYEaNyksQb5ODH1yXl5OXjTAw40san8UAFOosHg6kRyShVW/A3NCV0/pLlFowEcf1KRrjlMh7TdjScbaf8ZgPoGcQ/JJupoDpYtmND8TZP1yC0e+7BDBHgBPWIGKLbjNQIAAAAASUVORK5CYII=
530     www.mozilla.com      /pt-BR/img/tignish/about/icon-partnerships.png
517     www.mozilla.com      /pt-BR/img/tignish/about/icon-licensing.png
515     www.mozilla.com      /en-US/wtid.js
513     www.mozilla.com      /pt-BR/img/tignish/about/icon-blog.png
512     www.mozilla.com      /en-US/img/tignish/tips/forgery.png
506     www.mozilla.com      /ko/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
495     www.mozilla.com      /pt-BR/img/tignish/about/icon-store.png
485     www.mozilla.com      /sv-SE/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
484     www.mozilla.com      /pl/style/covehead/all-older.css
472     www.mozilla.com      /pl/js/mobile-nav.js
468     www.mozilla.com      /de/js/mobile-nav.js
465     www.mozilla.com      /pt-BR/img/tignish/about/icon-contact.png
460     www.mozilla.com      /pt-BR/img/fonts/MetaWebPro-Black.woff')%20format('woff
449     www.mozilla.com      /pt-BR/img/tignish/about/icon-logo.png
447     www.mozilla.com      /pt-BR/style/covehead/firefox.css
438     www.mozilla.com      /en-GB/img/fonts/MetaWebPro-Black.woff')%20format('woff
433     www.mozilla.com      /id/style/covehead/all-older.css
429     www.mozilla.com      /it/img/fonts/MetaWebPro-Black.woff')%20format('woff
422     www.mozilla.com      /de/style/covehead/all-older.css
411     www.mozilla.com      /fr/style/covehead/all-older.css
409     www.mozilla.com      /th/img/fonts/MetaWebPro-Black.woff)%20format(%22woff%22
408     www.mozilla.com      /en-US/img/tignish/video/play.png
398     www.mozilla.com      /ru/style/covehead/all-older.css
394     www.mozilla.com      /tr/img/fonts/MetaWebPro-Black.woff')%20format('woff
346     www.mozilla.com      /en-US/img/fonts/MetaWebPro-Bold.woff')%20format('woff
345     www.mozilla.com      /firefox/
335     www.mozilla.com      /en-US/img/fonts/MetaWebPro-Bold.woff)%20format(%22woff%22
326     www.mozilla.com      /en-US/newsletter/{$config['static_prefix']}/js/autofocus.js
323     www.mozilla.com      /tr/style/covehead/all-older.css
318     www.mozilla.com      /?WT.mc_id=s10&WT.mc_ev=click
314     www.mozilla.com      /ar/style/covehead/all-older.css
314     www.mozilla.com      /ar/img/fonts/MetaWebPro-Black.woff')%20format('woff
314     www.mozilla.com      /zh-CN/js/mobile-nav.js
304     www.mozilla.com      /pt-BR/style/covehead/all-older.css
304     www.mozilla.com      /en-US/img/tignish/security/key.png
300     www.mozilla.com      /pt-PT/img/tignish/gettingstarted/FIXME.png
296     www.mozilla.com      /en-US/images/nav_logo4.png

Comment 1

[Laura Forrest]

Have at it! Putting in 2.2 release for now.

Comment 2

[Laura Forrest]

Moving to 2.4 since Rik is traveling.

Comment 3

[Laura Forrest]

Anthony - can you tackle these within this next release?

Comment 4

[Anthony Ricaud (:rik)]

I can't find a reference to /en-US/style/covehead/all-older.css in the mozilla.com code. Maybe it's linked from somewhere else?

Comment 5

[Anthony Ricaud (:rik)]

Fixed MetaWebPro-Black.woff and bad IE parsing with r88708.

Comment 6

[Pascal Chevrel:pascalc]

links to sites-medium.png and descriptions updated to sites-shareaholic.png as the extension changed name in r89203.

Comment 7

[Pascal Chevrel:pascalc]

link to sites-FIXME was fixed in r89304

Comment 8

[Pascal Chevrel:pascalc]

Anthony's revision and mine are pushed to production

Comment 9

[Anthony Ricaud (:rik)]

r89309 to remove call to mobile-nav.js and r89313 to push it to prod.

Comment 10

[Laura Forrest]

Anthony - will you be able to complete this bug before the end of Q2?

Comment 11

[Anthony Ricaud (:rik)]

I think we've already removed most of the 404s. It would be nice to have a new list with referers.

Like I said in comment 4, I couldn't find any call to all-older.css on our code. With a referer, we could see what calls this file.

Comment 12

[mcbmoz]

Reassigning to Anurag! Can you provide an updated listed with referers, so Anthony can hit it up before we meet?

Comment 13

[Anurag Phadke[:[e-mail]]]

Created attachment 538147 [details]
404 w/referrers for mozilla.com - 4/23

attached file contains top 1000 404 errors including referrers for
www.mozilla.com dated 4/23

sample below:

date\tcount\tactual_url\treferring_url\n
2011-05-23        18382        /en-US/firefox/firefox.exe        -
2011-05-23        11578        /en-US/img/tignish/gettingstarted/sites-universia.png
http://www.mozilla.com/pt-BR/firefox/central/

note that some URLs like the first one above don't have a referrer, this
would imply some website or a bad redirect that is blocking the
referring url.

Comment 14

[mcbmoz]

Woot! Alright, assigning back over to Anthony! We're excited for your update!

Comment 15

[Laura Forrest]

Seems like this is mostly done, and will be complete after the dependencies are tracked down and resolved. 

Let's aim to have wrapped up by the end of the month.

Comment 16

[Fred Wenzel [:wenzel]]

Anthony, what's the status of this? What are the key things missing to closing this bug, and what can we do to unblock this?

Comment 17

[Anthony Ricaud (:rik)]

The two opened bugs needs to be resolved. For the /pt-BR/about, Pascal has a version on trunk that removes all 404s but it's not ready for prod yet.

For bug 664151, I need to learn a bit about CSP and find out why we receive those requests.

Comment 18

[Laura Forrest]

(In reply to comment #17)
> The two opened bugs needs to be resolved. For the /pt-BR/about, Pascal has a
> version on trunk that removes all 404s but it's not ready for prod yet.
> 
> For bug 664151, I need to learn a bit about CSP and find out why we receive
> those requests.

In that case I think this overarching bug can be closed. Woohoo!

Re-open if you think otherwise.