1080731 - Add mechanism to flag jobs as "ignore failures" until X

Status: RESOLVED INCOMPLETE

(Tree Management :: Treeherder, defect, P4)

Description

[Jonathan Griffin (:jgriffin)]

To support sheriffing of non-buildbot jobs in Treeherder, we need to add a mechanism to add a flag to a job type which indicates that failures of this job should be ignored until X.

X could be one of:
- a period of time (i.e., 2 days)
- indefinitely, until toggled
- until a linked bug is resolved

This flag should be applied per-tree, and so we might be able to re-use the UI for managing hidden jobs.

Once a job is thus flagged, all incoming jobs of that type should be marked with this "ignore failures" flag/classification.  Flagged jobs should not count toward the unclassified failure count, and should probably be marked in the UI with a distinct color (lavender, anyone?) if they fail, instead of red/orange.

Comment 1

[Jonathan French (:jfrench)]

I could imagine perhaps a field input and dropdown choice for [n] days/weeks/months/bug-number/indefinitely, which would dim the field input if indefinitely was chosen. And perhaps a tiny calendar if the user wanted to pick a specific day in the future corresponding to some release milestone, which would inject the [n] day into that field.

Comment 2

[Jonathan Griffin (:jgriffin)]

This was an early idea around what are now Tier 2 tests; I don't think we need this feature now per-se.  We may want to evolve Tier 2 support in the future, but it's likely not to be exactly as described here.