754692 - TestSuite: simplify reporting framework

Status: RESOLVED INVALID

(Core :: JavaScript Engine, defect)

Description

[Terrence Cole [:terrence]]

Currently, results.py is complicated by the requirement to report test results in a tinderbox-compatible format.  We don't actually use this ever, so we should rip it out and simplify results.py.  Ideally, it should be possible to easily add new test failure classifications to the result printer.  For example, it would be nice to report crash failures separately from valgrind failures separately from test semantic failures, etc.  It would also be nice if we could have more specific categories in the final failure printing than are present in the progress bar's columns.

Comment 1

[Terrence Cole [:terrence]]

Attachment: v0

Comment 2

[David Mandelin [:dmandelin]]

Question: When did we stop using the tinderbox format? If we truly don't need it anymore, that's fine, but at least when we started out, I thought we were running it on Tinderbox.

Comment 3

[Terrence Cole [:terrence]]

You are right.  I totally forgot about usetinderbox=1.