Closed Bug 1634159 Opened 5 years ago Closed 5 years ago

Report results also when the expected result is the same as the actual result

Categories

(Firefox Build System :: Task Configuration, enhancement)

Product:
Firefox Build System
Component:
Task Configuration
Type:
enhancement

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1632242

People

(Reporter: marco, Unassigned)

References

Details

Currently errorsummary.log contains a test_groups line containing the groups which were part of the task, and a test_result line for every test where the actual result was not the same as the expected result.

This makes it hard to know which groups actually run, as the groups in test_groups with no corresponding test_result line could either have run and passed or they could have been skipped.

Note: doing this would also help with https://bugzilla.mozilla.org/show_bug.cgi?id=1632546 (https://github.com/mozilla/mozci/issues/161), as we'd be able to tell if a WPT test belongs to testing/web-platform/tests or testing/web-platform/mozilla/tests by looking at the test ID.

Forgot I had already filed this...

No longer blocks: smart-scheduling
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.