400845 - Extend Tinderbox alternation.

Status: RESOLVED FIXED

(NSS :: Test, defect)

Description

[Slavomir Katuscak]

Recently we enabled PKIX testing and there is also shared DB testing which is not enabled by default, but we plan to enable it. These features will increase total testing time significantly. Before testing PKIX we run run_tests function (calling most of tests) once, now once more for PKIX tests, and shared DB tests will run it 2 times (once after DB upgrade and once for fresh DBs). Testing time is already too long and logs became big.

We need to split Tinderbox testing to shorter runs, which alternates all these features/options. We already alternate 64/32 bit builds, this should be extended.

Comment 1

[Slavomir Katuscak]

Attachment: Patch with changes.

This patch contains changes between previous version and what we use now. Implements what is written of description of this bug + some more functionality.

1. Modified Tinderbox to alternate those tests cycle and run one cycle per one run (actually 2, because contains DBG + OPT run).
2. Modified Tinderbox to put 64bit and 32bit results from one machine to just one column instead of 2. We don't test 32bit and 64bit parallel, so there is no need to keep 2 columns. Info which results are from which build is printed via TinderboxPrint function.
3. Enabled NSPR_LOG_MODULES="pkix:1"variable in Tinderbox testing.

Comment 2

[Slavomir Katuscak]

Committing changes to mozilla CVS (already running on trunk Tinderboxes since yesterday).

Checking in build-nss-util.pl;
/cvsroot/mozilla/security/tinderbox/build-nss-util.pl,v  <--  build-nss-util.pl
new revision: 1.2; previous revision: 1.1
done
Checking in build-nss.pl;
/cvsroot/mozilla/security/tinderbox/build-nss.pl,v  <--  build-nss.pl
new revision: 1.2; previous revision: 1.1
done