503908 - Import Mozilla.org CVS contents into SVN

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task, P2)

Comment 1

[Reed Loden [:reed]]

Been reading up on cvs2svn... I'm still debating whether importing the full history is the right thing to do or not. It will most assuredly make the number of CVS commits go sky high. Is there a reason why we can't just pick a date and do history since then, or even just import it fresh?

Comment 2

[David Boswell]

We need the whole history if it is at all possible.

Comment 3

[Reed Loden [:reed]]

From my first test run:

cvs2svn Statistics:
------------------
Total CVS Files:             11836
Total CVS Revisions:         44550
Total CVS Branches:              0
Total CVS Tags:                  0
Total Unique Tags:               0
Total Unique Branches:           0
CVS Repos Size in KB:       757402
Total SVN Commits:           17374
First Revision Date:    Fri Feb 27 17:52:24 1998
Last Revision Date:     Thu Jul 23 14:46:08 2009
------------------
Timings (seconds):
------------------
151.7   pass1    CollectRevsPass
  2.6   pass2    CleanMetadataPass
  0.0   pass3    CollateSymbolsPass
 14.2   pass4    FilterSymbolsPass
  0.1   pass5    SortRevisionSummaryPass
  0.0   pass6    SortSymbolSummaryPass
 12.4   pass7    InitializeChangesetsPass
 49.0   pass8    BreakRevisionChangesetCyclesPass
 54.3   pass9    RevisionTopologicalSortPass
  3.6   pass10   BreakSymbolChangesetCyclesPass
 12.2   pass11   BreakAllChangesetCyclesPass
 10.0   pass12   TopologicalSortPass
 27.1   pass13   CreateRevsPass
  0.0   pass14   SortSymbolsPass
  0.0   pass15   IndexSymbolsPass
 18.9   pass16   OutputPass
356.3   total

I used the following command:
cvs2svn/cvs2svn --dumpfile=svndump --dry-run --trunk-only --encoding=utf_8 --fallback-encoding=ascii --mime-types=mime.types --eol-from-mime-type cvs/mozilla-org/html

Comment 4

[Reed Loden [:reed]]

Ok, I have a test repo up at svn.mozilla.org/mozilla-org/. You can view it online at http://viewvc.svn.mozilla.org/vc/trunk/?root=mozilla-org.

I'm thinking about how to convert the e-mail addresses from % to @, but not sure that I care. Thoughts?

Comment 5

[Steven Garrity [:sgarrity]]

I'm not sure about the % vs. @ (doesn't seem like a big issue to me given it's only the history). The rest looks fine to me.

It looks like this is everything in the /html dir, plus /images and /style - is that right?

Comment 6

[Reed Loden [:reed]]

(In reply to comment #5)
> It looks like this is everything in the /html dir, plus /images and /style - is
> that right?

That's correct. Is that everything? Did I miss anything?

Comment 7

[David Boswell]

Looks good to me on first pass.  Good to see the history in there for the files.  If there's something specific you'd like me to be checking for, let me know.

Comment 8

[Steven Garrity [:sgarrity]]

Reed, I'm going to be travelling for a week+ starting on Thursday morning. Would it be possible to get this done today or early tomorrow? I'd like to get our conversion stuff done and committed before I go.

Comment 9

[Reed Loden [:reed]]

cvs2svn/cvs2svn --dumpfile=svndump --trunk-only --trunk=cvs --encoding=utf_8 --fallback-encoding=ascii --mime-types=mime.types --eol-from-mime-type cvs/mozilla-org/html

importing into svn.mozilla.org/projects/mozilla.org/branches/cvs

here's the output from the dump I'm using:

cvs2svn Statistics:
------------------
Total CVS Files:             11847
Total CVS Revisions:         44737
Total CVS Branches:              0
Total CVS Tags:                  0
Total Unique Tags:               0
Total Unique Branches:           0
CVS Repos Size in KB:       757727
Total SVN Commits:           17383
First Revision Date:    Fri Feb 27 17:52:24 1998
Last Revision Date:     Tue Jul 28 12:40:22 2009
------------------
Timings (seconds):
------------------
181.5   pass1    CollectRevsPass
  2.7   pass2    CleanMetadataPass
  0.0   pass3    CollateSymbolsPass
 17.5   pass4    FilterSymbolsPass
  0.1   pass5    SortRevisionSummaryPass
  0.0   pass6    SortSymbolSummaryPass
 12.3   pass7    InitializeChangesetsPass
 52.1   pass8    BreakRevisionChangesetCyclesPass
 57.7   pass9    RevisionTopologicalSortPass
  3.7   pass10   BreakSymbolChangesetCyclesPass
 11.9   pass11   BreakAllChangesetCyclesPass
 10.4   pass12   TopologicalSortPass
 28.2   pass13   CreateRevsPass
  0.0   pass14   SortSymbolsPass
  0.0   pass15   IndexSymbolsPass
320.5   pass16   OutputPass
698.6   total

Comment 10

[Reed Loden [:reed]]

Ok, all imported.

http://viewvc.svn.mozilla.org/vc/projects/mozilla.org/branches/cvs/