1120644 - Windows 7 reftest jobs return 1

Status: NEW

(Testing :: Reftest, defect)

Description

[Andrew Halberstadt [:ahal]]

All variants of mochitest and reftest on windows return a status code of 1. We're trying to move to a world where the return code of the job is used when trying to determine the tbpl_status.

This is soft blocking that effort as they will all turn red if enabled it. We can work around this issue in the short term though.

Comment 1

[Andrew Halberstadt [:ahal]]

Somewhere along the way (probably the switch to taskcluster), most suites started returning 0 again and we didn't catch it. It looks like only Windows 7 reftests exhibit this behaviour. Bug 1526777 will update the success_codes condition to reflect this.

Comment 2

[Andrew Halberstadt [:ahal]]

And for context, this is the condition I'm talking about:
https://searchfox.org/mozilla-central/rev/4587d146681b16ff9878a6fdcba53b04f76abe1d/testing/mozharness/scripts/desktop_unittest.py#934