Count of all 404s now happening on crash-stats prod

RESOLVED FIXED

Status

Infrastructure & Operations Graveyard
WebOps: Socorro
RESOLVED FIXED
5 years ago
2 years ago

People

(Reporter: peterbe, Unassigned)

Tracking

Details

Attachments

(1 attachment)

(Reporter)

Description

5 years ago
As part of https://bugzilla.mozilla.org/show_bug.cgi?id=787240 we want to put up redirects (permanent) for old URLs that have been left lying around (e.g. old bookmarks). 

Can you produce a tally of all URL hits that have 404'ed on crash-stats.mozilla.com?

If you have a tool for grouping them that would be great but I'd be perfectly happy to write a python script myself. For example, if you can upload a couple of zips of access logs grepped on 404 I can trawl through it with a script.
(Reporter)

Updated

5 years ago
Blocks: 787240
(In reply to Peter Bengtsson [:peterbe] from comment #0)
> As part of https://bugzilla.mozilla.org/show_bug.cgi?id=787240 we want to
> put up redirects (permanent) for old URLs that have been left lying around
> (e.g. old bookmarks). 
> 
> Can you produce a tally of all URL hits that have 404'ed on
> crash-stats.mozilla.com?
> 
> If you have a tool for grouping them that would be great but I'd be
> perfectly happy to write a python script myself. For example, if you can
> upload a couple of zips of access logs grepped on 404 I can trawl through it
> with a script.

You can SSH to socorro[1-2].webapp.phx1.mozilla.com via the Global VPN and have permissions that should let you read the logs in /var/log/httpd/crash-stats.mozilla.org/ on both servers.
(Reporter)

Comment 2

5 years ago
Created attachment 781134 [details]
biggest-404s-junejuly-2013.txt
(Reporter)

Comment 3

5 years ago
Attached all the URLs that 404'ed more than 10 times in June and July 2013. 

Now it's up to me in 787240 to do something about these.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.