1546510 - [stockwell disabled] can hide on-going failures

Status: NEW

(Testing :: General, defect, P3)

Description

[Geoff Brown [:gbrown]]

See bug 1427396 for an example.

After a bug is marked [stockwell disabled], frequent intermittents may continue on other test platforms (or the test disabling may have been ineffective). In this case, the bot never updates the stockwell tag, and the sheriffs seem more tolerant of on-going test failures.

This is tricky because we expect some trailing failure reports until the test disabling patch has been merged to all trees and tests on those merges have completed. Could the bot set needswork or disable-recommended if failures continue 48 hours after [stockwell disabled] is set?