283991 - Donate nightlies to the archive.mozilla.org archive

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task, P2)

Description

[Boris Zbarsky [:bzbarsky]]

I have Linux nightlies going back to about Oct 2001 sitting on my hard drive. 
I'd love to put them up on archive.mozilla.org if the new disk array is now in
place...

So here is the full situation:  I have the 14GB or so of nightlies in a single
directory.  The original dir on the server that the nightly came from is encoded
in the filename (eg "mozilla-i686-pc-linux-gnu-trunk-2001-10-11-08.tar.gz"). 
Almost all the files are tarballs, but a few (no more than out of 1000-some) are
actually full installer builds.  I suppose I can figure out which ones those are
and rename them or something.

So what's a good way forward here?  First of all, is there interest in getting
this done?  If so, what's the best way to proceed?

Comment 1

[Asa Dotzler [:asa]]

There's definitely interest from me. I've added a couple sysadmins with the hope
that they can help. 

Comment 2

[Boris Zbarsky [:bzbarsky]]

Note: comment 0 meant to say "no more than 5-6 out of 1000-some" in the
parenthetical comment.

Comment 3

[Dave Miller [:justdave]]

A couple options I can think of:
1) We set you up with an account on stage, and you just upload them to your home
directory, we can move them over to the archive site from there, since it's on
the same machine (this will take forever with that volume of data though)
2) Burn it to a few DVDs and mail it in

Comment 4

[Boris Zbarsky [:bzbarsky]]

I have no DVD burner or easy access to one.  I have no problem with running an
rsync or scp for a couple of days to upload the data, thought (adsl here, so
you're right that it'll take a while).  If the concern is that it'll take a lot
of time on your end to put it in the right places once it's there, then maybe we
can work something out to make that simpler?

Comment 5

[Dave Miller [:justdave]]

If you upload it, it'll be easier for us.  Sending DVDs would require someone to
go into the colo with a DVD-capable laptop or spending just as many hours
clogging up the office bandwidth trying to upload it from the office ;)

I've created bzbarsky for you on stage.mozilla.org and dropped in the ssh key
that's in your CVS account.  You can just drop them in your home directory (or
make a tree under that) and we can snag them from there.

Having them renamed appropriately would be useful, but I can probably script
that on this end if it's a problem.

Comment 6

[Chase Phillips]

(In reply to comment #5)
> Having them renamed appropriately would be useful, but I can probably script
> that on this end if it's a problem.

I'd like to have them in the same directory and file-naming conventions as
appears in archive.m.o and ftp.m.o for the nightlies currently.  As mentioned,
doing this automatically is a small programming task.  If someone wants to chomp
at the bit, speak up now.

bz, I think you can start uploading builds to stage at your leisure so we have
them for when we can get the renaming done and make them live.

Comment 7

[Boris Zbarsky [:bzbarsky]]

I may just do the rename as I upload.  Will know for sure in the next hour or
so.  ;)

Comment 8

[Boris Zbarsky [:bzbarsky]]

OK, I started them uploading.  I went ahead and munged things so that they'll
end up in the right directories with the right filenames (including the 4
full-installer builds) under my homedir on stage.

Comment 9

[tor]

I have backups of linux and windows builds since 25 May 2004 that I'd
be happy to donate if archive.m.o wants them.

Comment 10

[Asa Dotzler [:asa]]

Tor, we're definitely interested. The more complete our archive the easier time
we'll have tracking down regressions. Thanks.

Comment 11

[Boris Zbarsky [:bzbarsky]]

Files are uploaded.  I've checked that the md5sum output is the same as for my
local copies, so they should be as OK as whatever I have here... ;)  Whenever
you guys get a chance to copy them over to archive, go for it.

Comment 12

[Dave Miller [:justdave]]

Tor: do you have a stage account?  Can you do the same with the ones you were
interested in contributing?

Comment 13

[tor]

As far as I know, I don't have a stage account.

Comment 14

[Dave Miller [:justdave]]

(In reply to comment #13 by tor)
> As far as I know, I don't have a stage account.

You do now.  [e-mail], using the same key you use for CVS.

Comment 15

[Dave Miller [:justdave]]

ok, bzbarsky's contributions that we didn't already have have been copied from
his home directory into the ftp-archive area.

[root@manna bzbarsky]# rsync -av --ignore-existing 200* \
   /data/ftp-archive/pub/mozilla/nightly/
....
wrote 13822152318 bytes  read 16708 bytes  17419242.63 bytes/sec
total size is 14669108359  speedup is 1.06

Comment 16

[Dave Miller [:justdave]]

tor: let me know when you have these uploaded.

Comment 17

[timeless]

tor: once you've uploaded your builds, please reassign to justdave

Comment 18

[Dave Miller [:justdave]]

Justin is now the QA for this component.

Comment 19

[Dave Miller [:justdave]]

tor: any update on this?

Comment 20

[Dave Miller [:justdave]]

Reopen this and assign to [e-mail] if you get your files uploaded.