407347 - Sisyphus - JavaScript Tests - update kernel identification and known failures

Status: RESOLVED FIXED

(Testing Graveyard :: Sisyphus, defect)

Description

[Bob Clary [:bc] (inactive)]

Attachment: patch

mozilla/js/tests/runtests.sh uses a heuristic kernel pattern to match the test failures on a specific set of kernels so that it can eliminate known failures to determine the possible regressions and to determine if previously known failures are possibly fixed. The previous heuristic did not adequately distinguish between the various flavors of a kernel, e.g. fedora core 6 vs fedora core 7 vs fedora core 8. 

This patch modifies runtests.sh to create the heuristic pattern by replacing the sub-versions of the kernel with the pattern .* while leaving the top 3 levels and the distribution suffix. For example, 2.6.23.1-21.fc7 becomes 2.6.23.*fc7.

This patch also includes a utility script process-logs.sh which can be run on an existing set of log files to produce the possible fixes and regressions.

The patch also updates the JavaScript Tests known failures file.

Comment 1

[Bob Clary [:bc] (inactive)]

Checking in runtests.sh;
/cvsroot/mozilla/js/tests/runtests.sh,v  <--  runtests.sh
new revision: 1.7; previous revision: 1.6
done
RCS file: /cvsroot/mozilla/js/tests/process-logs.sh,v
done
Checking in process-logs.sh;
/cvsroot/mozilla/js/tests/process-logs.sh,v  <--  process-logs.sh
initial revision: 1.1
done
Checking in public-failures.txt;
/cvsroot/mozilla/js/tests/public-failures.txt,v  <--  public-failures.txt
new revision: 1.8; previous revision: 1.7
done

Comment 2

[(not currently active) Ted Mielczarek]

Mass move of Sisyphus bugs to Testing : Sisyphus. Filter on SisyphusMassMove to ignore.