613109 - Make it possible to run a mochitest-* test suite with an extension installed

Status: RESOLVED FIXED

(Testing :: Mochitest, defect)

Description

[(no longer active)]

It would be really helpful to add a command line option to runtests.py to install an xpi file in the profile folder as a usable extension.  This will give us the ability to, for example, run a test with Firebug installed, which sometimes could save us hours of desperate printf debugging.  Another useful extension for this purpose is DOM Inspector, but I guess the command line option could be capable of installing any extension.

Comment 1

[(not currently active) Ted Mielczarek]

There is --extra-profile-file=foo, which you can use to copy random things into the profile. I don't know that copying a .xpi will work.

automation.py has an installExtension method that would definitely work (we use it to install the reftest bits):
http://mxr.mozilla.org/mozilla-central/source/build/automation.py.in#913

we just don't currently expose that as a cmdline option. Would be easy enough to fix that.

Comment 2

[(no longer active)]

(In reply to comment #1)
> There is --extra-profile-file=foo, which you can use to copy random things into
> the profile. I don't know that copying a .xpi will work.

Mossop, do you know if it will work?

> automation.py has an installExtension method that would definitely work (we use
> it to install the reftest bits):
> http://mxr.mozilla.org/mozilla-central/source/build/automation.py.in#913

Hmm, I also found <http://mxr.mozilla.org/mozilla-central/source/layout/tools/reftest/runreftest.py#106> (registerExtension).  Is that also needed ater installExtension?

Also, the docs for installExtension say:

Copies an "installed" extension into the extensions directory of the given profile

What does "installed" mean in this context?

> we just don't currently expose that as a cmdline option. Would be easy enough
> to fix that.

Given the information above, I may give that a go!

Should I add the command line handling stuff in automation.py?

Comment 3

[(not currently active) Ted Mielczarek]

The registerExtension bit should no longer be necessary on trunk, since we don't require restarts.

The docstring there might just be out-of-date, I think it used to only support unpacked directories, but it clearly supports .xpi files now.

If you add the cmdline stuff in automation.py, we can use it in both Mochitest and Refest, but that means you'll have to do a little bit of implementation in both harnesses.

Comment 4

[Dave Townsend [:mossop]]

(In reply to comment #2)
> (In reply to comment #1)
> > There is --extra-profile-file=foo, which you can use to copy random things into
> > the profile. I don't know that copying a .xpi will work.
> 
> Mossop, do you know if it will work?

Just copying the raw XPI (naming it <id>.xpi) or the unpacked files from the xpi (in a directory named <id>) into <profile>/extensions should be all you need to do these days

Comment 5

[(no longer active)]

So I made some changes to runtests.py.in and then did both of these:

make -C objdir/testing/mochitest
make -f client.mk build

And my changes have not yet been picked up in objdir/_test/testing/mochitest/runtests.py.  How can I correctly make the build system pick up my changes without blowing away my entire objdir?

Comment 6

[:Gavin Sharp [email: [e-mail]]]

There is no runtests.py.in anymore, since bug 576026. Are you editing the wrong thing? The mochitest/testing makefile should just be copying it into objdir/_tests/ directly.

Comment 7

[(no longer active)]

Attachment: Patch (v1)

I almost forgot that I still have this in my queue!  This patch adds the --install-extension command line argument to runtests.py.  I've tested this for example to install Firebug in a mochitest profile.  Here's a sample command line that one should use:

python obj-ff-dbg/_tests/testing/mochitest/runtests.py --test-path=editor/libeditor/html/tests/test_bug635636.html --install-extension=[e-mail]

I think this is going to be very useful for a lot of developers, so let's try to get it in the tree!

Comment 8

[(no longer active)]

Comment on attachment 518906 [details] [diff] [review]
Patch (v1)

...and this time I forgot to set the requestee!  :-)

Comment 9

[Kyle Huey (Exited; not receiving bugmail, old account, do not use)]

Comment on attachment 518906 [details] [diff] [review]
Patch (v1)

Going to punt this to ted since test harnesses aren't really my area.

Comment 10

[(not currently active) Ted Mielczarek]

Comment on attachment 518906 [details] [diff] [review]
Patch (v1)

The unittest harnesses aren't in the build config module, FWIW.

Comment 11

[(no longer active)]

(In reply to comment #10)
> Comment on attachment 518906 [details] [diff] [review]
> Patch (v1)
> 
> The unittest harnesses aren't in the build config module, FWIW.

Does that mean that I should ask somebody else to review this?  I looked at <http://hg.mozilla.org/mozilla-central/log/tip/testing/mochitest/runtests.py> and I thought that Kyle might be less busy than you.  You guys are the only people who have reviewed that code...

Comment 12

[(not currently active) Ted Mielczarek]

Comment on attachment 518906 [details] [diff] [review]
Patch (v1)

It might be worthwhile to refactor some of this up into automation.py. There's an addCommonOptions function there for commandline options.

Comment 13

[(not currently active) Ted Mielczarek]

And yeah, khuey is only listed as a reviewer there on a patch that renamed the file from .py.in to .py. We should probably get the unit test harness module ownership sorted out for real.

Comment 14

[(no longer active)]

(In reply to comment #12)
> It might be worthwhile to refactor some of this up into automation.py. There's
> an addCommonOptions function there for commandline options.

Can this be done in a follow-up?

Comment 15

[(not currently active) Ted Mielczarek]

Sure, as long as you file it before landing. :)

Comment 16

[(no longer active)]

Sure, filed bug 642983.

Comment 17

[(no longer active)]

http://hg.mozilla.org/mozilla-central/rev/e4311825a9c7