422302 - Set up MXR for mozilla-central

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[Benjamin Smedberg]

Now that we're doing active development in mozilla-central we should have an official MXR instance for it. Timeless has set up an experimental one at http://mxr-test.landfill.bugzilla.org/mozilla-central/ which does almost exactly what we want. It has blame/log/raw links set up to point to mercurial, and a pull script from mercurial.

The only bug in the landfill version is that it is currently indexing the .hg metadata directory. This should be prevented, or else we end up with spurious search results.

Comment 1

[timeless]

hrm, i meant to fix it so that it wouldn't index .hg and .git directories, I thought I had pushed that. I've fixed it on swift (improved the code too), and I'll sync that tonight.

Comment 2

[Dave Miller [:justdave]]

comment 1 means we need a new version of MXR deployed to production before we can put this in, I assume.

Comment 3

[Benjamin Smedberg]

I don't know... whatever it takes.

Comment 4

[Mike Schroepfer]

Upping the priority on this..

Comment 5

[Justin Fitzhugh]

given this is higher priority, moving back to server-ops

Comment 6

[Dave Miller [:justdave]]

timeless: what do I need to do to get your new Hg-capable version of MXR into production?  I'd prefer to have it in version control first (see bug 366155), but we're desperate enough right now we can probably get away with another tarball/patch deploy like we did last time.

Comment 7

[Benjamin Smedberg]

Timeless sent me the code running on mxr-test.landfill and I have put it up at http://hg.mozilla.org/users/bsmedberg_mozilla.com/mxr/ revision 95c95aed0c15

I imported everything, configuration differences and all... and because it was sent as a zipfile, there may be some files which were symlinks and are now empty directories.

Comment 8

[Dave Miller [:justdave]]

Is there a quickstart guide or something on how to use Hg that you all recommend? :)

Comment 9

[Benjamin Smedberg]

http://developer.mozilla.org/en/docs/Mercurial has the basics. Feel free to ping me on IRC with questions.

Comment 10

[timeless]

fwiw, that does get reflected by another tree
http://mxr-test.landfill.bugzilla.org/mozillausers-central/source/bsmedberg_mozilla.com/mxr/

so you can see that most of the symlinks survived :)

Comment 11

[Dave Miller [:justdave]]

OK, take 1 is at: http://mxr-stage.mozilla.org/mozilla-central/

Note that's quite likely the only root on mxr-stage that actually works right now.  This is basically a direct checkout of bsmedberg's repo with the mozilla-central config fixed to work on mxr-stage.  There's a whole mess of stuff in the config file (which is obviously off of landfill) which doesn't exist on mxr-stage, not to mention the paths are all wrong.

In order to move this onto the production mxr, the config is going to have to be merged with the existing production somehow.

Comment 12

[Benjamin Smedberg]

Dave, is fulltext indexing supposed to work on that tree or not? It doesn't appear to:

http://mxr-stage.mozilla.org/mozilla-central/search?string=ns_stack_

Comment 13

[Dave Miller [:justdave]]

(In reply to comment #12)
> Dave, is fulltext indexing supposed to work on that tree or not?

Yet another config difference from landfill.  The path to the glimpse binary was set wrong in the config.  I just fixed that.  Should work now.

Comment 14

[Benjamin Smedberg]

mozilla-central now appears to work correctly on mxr-stage.

Comment 15

[Dave Miller [:justdave]]

So here's the current state of this thing...

I got the config file merged with production last night, added a bunch of missing symlinks.  Got some help on IRC today with Hg and figured out how to commit, and committed my changes back.  Realized I forgot the index pages, and I'm working now on trying to make the index pages something sane (the stuff off landfill has lots of strange content that wouldn't be appropriate for production).

I should have *all* of the sourceroots working on mxr-stage at some point in the next hour or two, and then I think we'll need a day or so for people to poke at it before I move it to the production URL just to make sure nothing major is broken (perhaps announce an outage window?  Hate to just deploy it without warning people).

Comment 16

[Dave Miller [:justdave]]

OK, not done yet.  Got the main index page completely revamped except for the list of sourceroots that are available and then fell asleep (one of the minor dangers of working on it at home instead of in the office).  Should have ther est of it shortly after church today.

Comment 17

[Dave Miller [:justdave]]

We'll be pushing this into production during the Tuesday night outage window.

Comment 18

[Dave Miller [:justdave]]

ok, This is in production now.  MXR itself needs some cleanup yet, but that's outside the scope of this bug, mozilla-central is now at http://mxr.mozilla.org/mozilla-central/