461115 - Run ALL available Junit tests and fail build in case of errors

Status: RESOLVED FIXED

(Rhino Graveyard :: Core, defect)

Description

[Marc]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Firefox/3.0.3
Build Identifier: 

Current build doesn't run all JUnit tests (it doesn't even compile them all) and doesn't fail when some tests failed. Both points are quite bad.

Reproducible: Always

Steps to Reproduce:
1.
2.
3.

Comment 1

[Marc]

Attachment: Patch allowing to compile and run all JUnit tests and to fail in case of test failure(s)

Patch solves the problem. Note that due to inconsistent naming (*Test for classes that are not JUnit test cases) the tests selection is more complicated and made lead to forget tests in the future when they are placed in other package(s). For the same reason, the patch renames and helper class of one test case.

Comment 2

[Norris Boyd]

Fixed:

Checking in testsrc/build.xml;
/cvsroot/mozilla/js/rhino/testsrc/build.xml,v  <--  build.xml
new revision: 1.12; previous revision: 1.11
done
Checking in testsrc/org/mozilla/javascript/tests/Bug409702Test.java;
/cvsroot/mozilla/js/rhino/testsrc/org/mozilla/javascript/tests/Bug409702Test.java,v  <--  Bug409702Test.java
new revision: 1.4; previous revision: 1.3
done

Comment 3

[Marc]

For info: StandardTests wrongly reports as successful > 600 failing tests. I've attached a patch to
https://bugzilla.mozilla.org/show_bug.cgi?id=460739 as it is related to the problem reported there.