1215225 - pub/vcs-archive/README file no longer displayed in web-view directory index

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Product Delivery, task)

Description

[hwine]

File was originally displayed when created in July, but discovered to no longer be accessible yesterday (whey trying to point a community member to it's contents).

File is on server:
    [[e-mail]3 vcs-archive]$ ll
    total 5085692
    -r--r--r-- 1 root  root       53451 May 26 22:41 bzr-bugzilla-plugins.tgz
    -r--r--r-- 1 root  root   175832156 May 26 22:40 bzr-bugzilla.tgz
    -r--r--r-- 1 hwine hwine  550773194 May 26 23:40 cvs-l10n.tjz
    -r--r--r-- 1 root  root  3639849496 May 26 23:20 cvs-main.tjz
    -r--r--r-- 1 hwine hwine  820765840 Jun  9 23:48 cvs-www.tjz
    drwxr-x--- 2 hwine hwine       4096 Jun 10 04:04 hwine
    drwxr-xr-x 2 root  root        4096 May 21 16:20 pvt
    -r--r--r-- 1 root  root         838 Jul 28 23:13 README

And file is available directly from http://archive.mozilla.org/pub/vcs-archive/README


But not in web view http://archive.mozilla.org/pub/vcs-archive/
    Index of /pub/vcs-archive
    [ICO]   Name    Last modified   Size    Description
    [DIR]   Parent Directory                -        
    [ ]     bzr-bugzilla-plugins.tgz        26-May-2015 22:41       52K      
    [ ]     bzr-bugzilla.tgz        26-May-2015 22:40       168M     
    [ ]     cvs-l10n.tjz    26-May-2015 23:40       525M     
    [ ]     cvs-main.tjz    26-May-2015 23:20       3.4G     
    [ ]     cvs-www.tjz     09-Jun-2015 23:48       783M     
    [DIR]   pvt/    21-May-2015 16:20       -        

    ftp3.dmz.scl3.mozilla.com in UTC

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

Pretty sure there's some Apache config which hides README files, for reasons unknown to me.

Comment 2

[Jason Thomas [:jason]]

There is a IndexIgnore README* in thhe ftp cluster httpd.conf. I don't have reference to why this was added or changed.

Comment 3

[Eric Ziegenhorn :ericz]

All of our RHEL 5 and 6 boxes ignore README* in the indexes by default in httpd.conf:

   IndexIgnore .??* *~ *# HEADER* README* RCS CVS *,v *,t

This has been in puppet for a long time.  I see no evidence of recent changes in the svn log.  It looks to me like it's not even possible to override this locally -- we'd have to globally allow README* and then specifically disallow it where we need it.

Comment 4

[Eric Ziegenhorn :ericz]

How would you like to handle this Hal?

Comment 5

[Jeremy Orem [:oremj]]

We are migrating everything, except /pub/seamonkey and /pub/b2g, tomorrow to s3.

Comment 6

[hwine]

Post move we'll rename the file to something that shows.

Questions:

1. What is the process for renames on S3? 

2. What are the equivalent rules for S3 via http? I.e. Will "HEADER.*" be merged into the index output as with apache?

Comment 7

[Jeremy Orem [:oremj]]

There shouldn't be hidden files once we move to s3. No, the header files will not be merged.

Comment 8

[Eric Ziegenhorn :ericz]

I don't know about renames on s3, but I imagine the other guys in this thread do.

Comment 9

[hwine]

Great! It sounds like I won't have to do anything!

I'll check after things are stable and likely close then.

Comment 10

[Nick Thomas [:nthomas] (UTC+12)]

http://archive.mozilla.org/pub/vcs-archive/README is visible now, but could do with 'Content-Type: text/plain' being set on it so that it shows in browser rather than downloads.

If you want to modify the file, or the directory, regularly then ask oremj for an IAM account which grants you access to pub/vcs-archive.

Comment 11

[:Atoll]

I'm going to close this since the file is now shown in the index, which addresses the original request. Setting needinfo :hwine for the text/plain which is, it seems, handled by CloudOps.