63228 - add unit testing to the build system

Status: RESOLVED WORKSFORME

(SeaMonkey :: Build Config, defect)

Description

[dprice (gone)]

we want to add a new pass to the build system that will go through and run all
unit tests in the tree.  The rule will be called all-tests  Once the tests are
hooked into the build system, we can plug them into tinderbox and turn the tree
orange when tests fail.  Hopefully it will make life easier when trying to hunt
down regressions.

sample tests can be:
-  an executable that exits with 0 as success and non-zero or crash for failure.
 A sample would be

all-tests::
	TestProgram

- an executable that produces some output.  That output is compared to a text
file containting the expected output...

all-tests::
	TestProgram | diff -c - expected-output.txt

diff isn't included with the standard windows tools so we may need a script that
will run a program and diff its output.  something like...

diffing-test.pl -p 'TestProgram' -e 'expected-output'

 - running a script through xpcshell to test various low level com components.
I'm not exactly sure how this will work yet.  It will probably look something
like...

all-tests::
	diffing-test.pl -p 'xpcshell testscript' -e 'expected-output.txt'


This will be the master bug.  Various other bugs will be created for the
individual tasks.  This bug will depend on those tasks.

Comment 1

[dprice (gone)]

per chofmann moving past mozilla 1.0

Comment 2

[Vedran Miletic]

retargeting

Comment 3

[:Gavin Sharp [email: [e-mail]]]

We have |make check| now, as well as a bunch of other unit testing frameworks (mochitest, reftest, etc).