1634159 - Report results also when the expected result is the same as the actual result

Status: RESOLVED DUPLICATE of bug 1632242

(Firefox Build System :: Task Configuration, enhancement)

Description

[Marco Castelluccio [:marco]]

Currently errorsummary.log contains a test_groups line containing the groups which were part of the task, and a test_result line for every test where the actual result was not the same as the expected result.

This makes it hard to know which groups actually run, as the groups in test_groups with no corresponding test_result line could either have run and passed or they could have been skipped.

Note: doing this would also help with https://bugzilla.mozilla.org/show_bug.cgi?id=1632546 (https://github.com/mozilla/mozci/issues/161), as we'd be able to tell if a WPT test belongs to testing/web-platform/tests or testing/web-platform/mozilla/tests by looking at the test ID.

Comment 1

[Marco Castelluccio [:marco]]

Forgot I had already filed this...